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ABSTRACT 



This report is the product of a 2 -year project during which 
the Committee on Community -Level Programs for Youth, a 15-member panel, 
evaluated and integrated the current science on adolescent health and 
development with research and findings regarding program design, 
implementation, and evaluation of community programs for youth. It highlights 
essential elements of adolescent well-being and healthy development, offering 
recommendations for policy, practice, and research. It also discusses 
features of programs that can contribute to successful transition from 
adolescence to adulthood. Ten chapters include the following: (1) "Setting 

the Stage" (e.g., committee charge and U.S. youth); (2) "Adolescent 
Development"; (3) "Personal and Social Assets that Promote Well-Being" (e.g., 
how to measure wellbeing and theoretical perspectives) ; (4) "Features of 

Positive Developmental Settings"; (5) "The Landscape of Community Programs 
for Youth" (e.g., insights from nonexperimental schools and features of 
community programs); (6) "Lessons from Experimental Evaluations" (e.g., 
reviews and meta-analyses of evaluations and three model program 
evaluations) ; (7) "Generating New Information" (evaluating community youth 

programs and questions asked in comprehensive evaluations) ; (8) "Data and 

Technical Assistance Resources" (e.g., uses of social indicator data and data 
sources); (9) "Funding and Support for Programs"; and (10) "Conclusions and 
Recommendations." Four appendixes include fundamental principles of human 
development, theoretical frameworks for conceptualizing positive 
developmental processes, biographical sketches, and related reports from the 
National Archives. (Contains approximately 780 references.) (SM) 
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Executive Summary 



dolescence is the pivotal period between childhood and 
adulthood. It is the time when youth need to acquire the 
attitudes, competencies, values, and social skills that will 
carry them forward to successful adulthood. It is also the 
time when they need to avoid choices and behaviors that 
will limit their future potential. Parents and families play a 
crucial role in helping young people navigate this phase. 
In the past, schools, neighborhoods, and communities ex- 
tended and enhanced positive development and supported 
young people. Indeed, an enduring image of American life 
is the participation of neighbors and community members 
watching out for children, taking responsibility for their 
safety and well-being, and helping to steer them in the right 
direction. 

In recent decades, a number of social forces have 
changed both the landscape of family and community life 
and the expectations for young people. A combination of 
factors have weakened the informal community support 
once available to young people: high rates of family mobil- 
ity; greater anonymity in neighborhoods, where more par- 
ents are at work and out of the home and neighborhood 
for long periods, and in schools, which have become larger 
and much more heterogeneous; extensive media exposure 
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to themes of violence and heavy use and abuse of drugs and alcohol; and, 
in some cases, the deterioration and disorganization of neighborhoods 
and schools as a result of crime, drugs, and poverty. At the same time, 
today’s world has become increasingly complex, technical, and 
multicultural, placing new and challenging demands on young people in 
terms of education, training, and the social and emotional skills needed 
in a highly competitive environment. Finally, the length of adolescence 
has extended to the mid- to late twenties, and the pathways to adulthood 
have become less clear and more numerous. 

Concerns about youth are at the center of many policy debates. The 
future well-being of the country depends on raising a generation of 
skilled, competent, and responsible adults. Yet at least 25 percent of 
adolescents in the United States are at serious risk of not achieving “pro- 
ductive adulthood” and face such risks as substance abuse, adolescent 
pregnancy, school failure, and involvement with the juvenile justice sys- 
tem. Depending on their circumstances and choices, they may carry those 
risks into their adult lives. Public investments in programs to counter 
such trends have grown significantly over the past decade or so. For the 
most part, these efforts have targeted specific problems and threats to 
young people. Substantial public health investments have also been made 
to prevent such problems as teen smoking, sexually transmitted diseases, 
unintended pregnancy, and alcohol and other drug use. Major funding 
has been allocated to the prevention and control of juvenile delinquency 
and youth crime. 

These efforts have led to some successes. On one hand, adolescent 
well-being and behavior have shown substantial improvement in some 
areas since the late 1980s. Serious violent juvenile crime has declined, 
teen pregnancy has decreased, and more young people are graduating 
from high school and participating in volunteer and community service. 
On the other hand, cigarette smoking, HIV infection, school violence, 
and obesity have increased during this period, particularly among youth 
in high-risk urban neighborhoods and very poor rural communities. In 
addition, many youth are entering the labor market with inadequate 
knowledge skills, such as the ability to communicate effectively, resolve 
conflicts, and prepare for and succeed in a job interview. 

Continued efforts to prevent and control these and other problems 
are clearly needed. An exclusive focus on problems, however, narrows 
the vision that society should have for all of its young people. Many 
who study adolescent development and work with young people have 
increasingly come to believe that being problem-free is not fully pre- 



Executive Summary 



3 



pared. Beyond eliminating problems, one needs skills, knowledge, and a 
variety of other personal and social assets to function well during adoles- 
cence and adulthood. Thus a broader, more holistic view of helping 
youth to realize their full potential is gaining wider credence in the world 
of policy and practice. 

This approach is not viewed as replacing the focus on preventing 
problems, but rather creating a larger framework that promotes positive 
outcomes for all young people. Public and private organizations are now 
engaged in a wide array of activities that fall within this framework. 
Such programs include mentoring, school-based community service pro- 
grams and other volunteer activities, school-to-work transition programs, 
parenting skills, arts and recreation activities, among others. All are part 
of a new direction in public policy that places children and adolescents 
once again at the center of neighborhood and community life, where 
they can engage with caring adults inside and outside their families, de- 
velop a sense of security and personal identity, and learn rules of behav- 
ior, expectations, values, morals, and skills needed to move into healthy 
and productive adulthood. 

Recent increases in funding from federal agencies, foundations, state 
and local governments, and the private sector have given impetus to these 
efforts and, at the same time, focused attention on the need to assess 
program effects and provide objective, reliable information to guide fu- 
ture investment. There is great diversity among the organizations that 
offer these programs, as well as the programs’ emphases, curricula, and 
populations served. Organizations offering youth programs range from 
large national youth-serving agencies, such as 4-H, Boys and Girls Clubs, 
Girls, Inc., Boy Scouts, and Girl Scouts, to more local youth sports orga- 
nizations, community centers, schools, libraries, faith-based institutions, 
museums, arts centers, service clubs, and numerous other grassroots or- 
ganizations. Programs may target youth broadly or focus on a subset of 
them, defined by characteristics such as neighborhood, ethnic group, or 
special need. The focus of these programs may be general or specific 
(e.g., centered on sports, religion, or academic success). 

This report focuses broadly on community-based programs for youth 
and examines what is known about their design, implementation, and 
evaluation. These are programs located in the communities in which the 
youth live. In the context of this report, communities may include neigh- 
borhoods, block groups, towns, and cities, as well as nongeographically 
defined communities based on family connections and shared interests or 
values. 
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THE COMMITTEE CHARGE 



The Committee on Community- Level Programs for Youth was es- 
tablished by the Board on Children, Youth, and Families and the Com- 
mittee on Adolescent Health and Development (formerly the Forum on 
Adolescence). The specific charge to the committee was: 

0 Review and synthesize available data on community interventions 
and programs to promote positive outcomes for adolescent devel- 
opment; 

° Assess the strengths and limitations of data sources and indicators 
commonly used to characterize youth health, development, and 
well-being; 

0 Assess the strengths and limitations of methodologies and ap- 
proaches used to evaluate these activities; and 

0 Identify gaps and central questions for the design of a unified 
conceptual framework and research agenda to promote the 
healthy development of youth. 

To the extent feasible, the committee was asked to identify those 
programs with sufficiently strong evidence to suggest that they could 
serve as models for communities that are enhancing their youth pro- 
grams. 

Support for the committee’s work came from private foundations 
and federal agencies. All those supporting this study share a common 
desire to understand more about how community programs for youth 
can be designed to promote the positive development of youth. Founda- 
tions seek guidance about wise investments in adolescent programming; 
policy makers seek guidance regarding effective prevention and youth 
development approaches; and program practitioners and managers seek 
assistance as they work to design and evaluate their programs. 

The committee examined programs that target young people ages 10 
to 18. While we made the decision to focus our review and analysis on 
programs promoting a “youth development” perspective, we rejected the 
often polarized view of youth programming as either “prevention/prob- 
lem-centered” or “ youth development” centered. Our view is that both 
approaches are valuable and necessary and that, in practice, the distinc- 
tion between the two is often blurred. 

The committee turned to multiple types and sources of information 
for this report — theory, practical experience, and qualitative and quanti- 
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tative research and data — in order to gain as broad a perspective as 
possible on positive youth development. Based on its analysis of this 
information, the committee generated a set of conclusions and recom- 
mendations organized around two primary themes: (a) policy and prac- 
tice; and (b) research, evaluation, and data collection. 

In beginning its work, the committee agreed on a set of four core 
concepts that serve as a foundation for this report: 

© Some youth are doing very well; 

© Some youth are taking dangerous risks and doing poorly; 

© All young people need a variety of experiences to develop to their 
full potential; 

© Some young people have unmet needs and are particularly at risk 
of participating in problem behaviors (e.g., dropping out of 
school, participating in violent behavior). These include young 
people who often, but by no means always, live in high-risk neigh- 
borhoods, are poor, experience repeated racial and ethnic dis- 
crimination, and have a substantial amount of unsupervised time 
during nonschool hours. Other youth who are in special need of 
more programs include youth with disabilities of all kinds, youth 
from troubled family situations, and youth with special needs for 
places to find emotional support. 

Although the committee stresses the importance of providing sup- 
port for all youth regardless of economic status, we were also particu- 
larly interested in understanding community programs for young people 
who have the greatest need coupled with the fewest resources. We found 
very little research to talk specifically about the kinds of programs that 
would be particularly appropriate for these disadvantaged and under- 
served youth, including youth who are gay and lesbian, youth who are 
bullied at school, and youth who have experienced sexual and other 
forms of harassment. 



POLICY AND PRACTICE 

Promoting Adolescent Development at the Program Level 

Understanding adolescent development and the factors contributing 
to the healthy development of all young people is critical to the design 
and implementation of community programs for youth. Consequently 

ERIC 25 
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BOX ES-B 

Personal! airod Social Assets That Facilitate Positive 
Youth Development 

Physical development 

• Good health habits 

• Good health risk management skills 

Intellectual development 

• Knowledge of essential life skills 

° Knowledge of essential vocational skills 

• School success 

• Rational habits of mind — critical thinking and reasoning skills 

• In-depth knowledge of more than one culture 

• Good decision-making skills 

• Knowledge of skills needed to navigate through multiple cultural 
contexts 

Psychological and emotional development 

• Good mental health including positive self-regard 

• Good emotional self-regulation skills 
0 Good coping skills 



the committee began its work by identifying a set of personal and social 
assets that increase the healthy development and well-being of adoles- 
cents and facilitate a successful transition from childhood, through ado- 
lescence, and into adulthood. We grouped these assets into four broad 
developmental domains: physical, intellectual, psychological and emo- 
tional, and social development. Box ES-1 summarizes the four domains 
and specifies the assets within each. 



Conclusions 

□ Individuals do not necessarily need the entire range of assets to 
thrive; in fact, various combinations of assets across domains reflect 
equally positive adolescent development. 
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• Good conflict resolution skills , 

® Mastery motivation and positive achievement motivation 
0 Confidence in one’s personal efficacy 

.• “Planfulness” — planning for the future and future life events 
° Sense of personal autonomy/responsibility for self 

• Optimism coupled with realism 

• Coherent and positive personal and social identity 

• ' Prosocial and culturally sensitive values * ; . 

• Spirituality or a sense of a ‘larger? purpose in life 

• Strong moral character ; ; - * _ • ' • " 

6 A commitment to good use of time 




Social development 

0 Connectedness-perceived good relationships and trust with parents, 
peers, and some other adults 

• Sense of social place/integration- — being connected and valued by 



larger social networks - V ^ T * • v 

• Attachment to prosocial/conventional institutions, such as school, 
church, nonschool youth programs 

• Ability to navigate in multiple cultural contexts 

• Commitment to civic engagement 'i „ 



□ Having more assets is better than having few. Although strong 
assets in one category can offset weak assets in another category, life is 
easier to manage if one has assets in all four domains. 

□ Continued exposure to positive experiences, settings, and people, 
as well as opportunities to gain and refine life skills, supports young 
people in the acquisition and growth of these assets. 

Moving now from the individual to the environment, young people 
develop these positive personal and social assets in settings that have the 
following features. 

0 Physical and psychological safety and security; 

0 Structure that is developmentally appropriate, with clear expecta- 
tions for behavior as well as increasing opportunities to make 
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decisions, to participate in governance and rule-making, and to 
take on leadership roles as one matures and gains more expertise; 

° Emotional and moral support; 

° Opportunities for adolescents to experience supportive adult rela- 
tionships; 

° Opportunities to learn how to form close, durable human rela- 
tionships with peers that support and reinforce healthy behaviors; 

° Opportunities to feel a sense of belonging and being valued; 

° Opportunities to develop positive social values and norms; 

0 Opportunities for skill building and mastery; 

0 Opportunities to develop confidence in one's abilities to master 
one’s environment (a sense of personal efficacy); 

0 Opportunities to make a contribution to one’s community and to 
develop a sense of mattering; and 

0 Strong links between families, schools, and broader community 
resources. 

Table ES-1 provides details on the features of positive developmen- 
tal settings. 



Conclusions 

□ Since these features typically work together in synergistic ways, 
programs with more features are likely to provide better supports for 
young people’s positive development. 

□ Community programs can expand the opportunities for youth to 
acquire personal and social assets and to experience the broad range of 
features of positive developmental settings. 

Among other things, community programs can incorporate opportu- 
nities for physical, cognitive, and social and emotional development; 
opportunities to address issues of ethnic identity, sexual identity, and 
intergroup relationships; opportunities for community involvement and 
service; and opportunities to interact with caring adults and a diversity 
of peers who hold positive social norms and have high life goals and 
expectations. 

Recommendation 1 — Community programs for youth should be 
based on a developmental framework that supports the acquisition of 
personal and social assets in an environment, and through activities, that 
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TABLE ES-1 Features of Positive Developmental Settings 



Descriptors Opposite Poles 



Physical and 

Psychological 

Safety 


Safe and health-promoting facilities; 
practice that increases safe peer group 
interaction and decreases unsafe or 
confrontational peer interactions. 


Physical and health 
dangers; fear; feeling of 
insecurity, sexual and 
physical harassment; and 
verbal abuse. 


Appropriate 

Structure 


Limit setting; clear and consistent rules 
and expectations; firm-enough control; 
continuity and predictability; clear 
boundaries; and age-appropriate 
monitoring. 


Chaotic; disorganized; 
laissez-faire; rigid; 
overcontrolled; and 
autocratic. 


Supportive 

Relationships 


Warmth; closeness; connectedness; 
good communication; caring; support; 
guidance; secure attachment; and 
responsiveness. 


Cold; distant; 

overcontrolling; ambiguous 
support; untrustworthy; 
focused on winning; 
inattentive; unresponsive; 
and rejecting. 


Opportunities to 
Belong 


Opportunities for meaningful inclusion, 
regardless of one’s gender, ethnicity, 
sexual orientation, or disabilities; 
social inclusion, social engagement and 
integration; opportunities for socio- 
cultural identity formation; and support 
for cultural and bicultural competence. 


Exclusion; marginalization; 
and intergroup conflict. 


Positive 
Social Norms 


Rules of behavior; expectations; 
injunctions; ways of doing things; 
values and morals; and obligations 
for service. 


Normlessness; anomie; 
laissez-faire practices; 
antisocial and amoral 
norms; norms that 
encourage violence; 
reckless behavior; 
consumerism; poor health 
practices; and conformity. 


Support for 
Efficacy and 
Mattering 


Youth-based; empowerment practices 
that support autonomy; making a real 
difference in one’s community; and 
being taken seriously. Practices that 
include enabling; responsibility 
granting; and meaningful challenge. 
Practices that focus on improvement 
rather than on relative current 
performance levels. 


Unchallenging; 
overcontrolling; 
disempowering; and 
disabling. Practices that 
undermine motivation and 
desire to learn, such as 
excessive focus on current 
relativeperformance level 
rather than improvement. 



continued 
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TABLE ES-1 


Continued 






Descriptors 


Opposite Poles 


Opportunities for 
Skill Building 


Opportunities to learn physical, 
intellectual, psychological, emotional, 
and social skills; exposure to 
intentional learning experiences; 
opportunities to learn cultural literacies, 
media literacy, communication skills, 
and good habits of mind; preparation 
for adult employment; and 
opportunities to develop social and 
cultural capital. 


Practice that promotes bad 
physical habits and habits 
of mind; and practice that 
undermines school and 
learning. 


Integration of 
Family, School, 
and Community 
Efforts 


Concordance; coordination; and 
synergy among family, school, and 
community. 


Discordance; lack of 
communication; and 
conflict. 



promote both current adolescent well-being and future successful transi- 
tions to adulthood. 

Serving Diverse Youth at the Community Level 

Many different individual organizations provide community pro- 
grams for youth; each has its own unique approach and activities. How 
communities organize youth policies, as well as support individual pro- 
grams, also varies from community to community. For example, the 
organizing body might be the mayor’s office, a local government agency, 
or a community foundation. A private intermediary organization or an 
individual charismatic leader, such as a minister or a rabbi, might also 
organize such efforts. However, it is often the case that there is no single 
person or group that is responsible for either monitoring the range and 
quality of community programs for youth or making sure that informa- 
tion about community programs is easily accessible to members of the 
community. 



Conclusion 

□ Adolescents who spend time in communities that are rich in de- 
velopmental opportunities for them experience less risk and show evi- 
dence of higher rates of positive development. A diversity of program 
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opportunities in each community is more likely to support broad adoles- 
cent development and attract the interest of and meet the needs of a 
greater number of youth. 

Community programs for youth differ in their objectives, design, 
approach, and focus, and some may choose to emphasize certain pro- 
gram features over others. Even with the best staff and best funding, no 
single program can necessarily serve all young people or incorporate all 
of the features of positive developmental settings. The complexities of 
adolescent development and the increasing diversity of the country make 
the heterogeneity of young people in communities both a norm and a 
challenge. Therefore, effective programs must be flexible enough to 
adapt to this diversity among the young people they serve and the com- 
munities in which they operate. 

Recommendation 2 — Communities should provide an ample array 
of program opportunities that appeal to and meet the needs of diverse 
youth, and should do so through local entities that can coordinate such 
work across the entire community. Particular attention should be placed 
on programs for disadvantaged and underserved youth. 

Recommendation 3 — To increase the likelihood that an ample array 
of program opportunities will be available, communities should put in 
place some locally appropriate mechanism for monitoring the availabil- 
ity, accessibility, and quality of programs for youth in their community. 

Recommendation 4 — Private and public funders should provide the 
resources needed at the community level to develop and support commu- 
nity-wide programming that is orderly, coordinated, and evaluated in 
reasonable ways. In addition to support at the community level, this is 
likely to involve support for intermediary organizations and collaborative 
teams that include researchers, practitioners, funders, and policy makers. 



RESEARCH, EVALUATION, AND DATA COLLECTION 

The multiple groups concerned about community programs for 
youth — policy makers, families, program developers and practitioners, 
program staff, and young people themselves — have in common the de- 
sire to know whether programs make a difference in the lives of young 
people, their families, and their communities. Some are interested in 
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learning about the effectiveness of specific details in a program; some 
about the effects of a given program; some about the overall effect of a 
set of programs together; and others about the effects of related kinds of 
programs. Research, program evaluation, and social indicator data can 
help improve the design and delivery of programs, and in doing so can 
play a significant role in answering such questions and improving the 
well-being and future success of young people. 



Research 

The committee first reviewed research on both adolescent develop- 
ment and the features of positive developmental settings that support it. 
In both cases, the research base is just becoming comprehensive enough 
to allow for tentative conclusions about the individual assets that charac- 
terize positive development and features of settings that support it. The 
committee used a variety of criteria to suggest the tentative lists of both 
important individual-level assets and features of settings that support 
positive development outlined in Box ES-1 and Table ES-1. These sug- 
gestions are based on scientific evidence from short- and long-term ex- 
perimental and observational studies, one-time large-scale survey stud- 
ies, and longitudinal survey studies reviewed by the committee. However, 
much more comprehensive work is needed. 



Conclusions 

□ More comprehensive longitudinal research, that either builds on 
current efforts or involves new efforts, is needed on a wider range of 
populations that follows children and adolescents well into adulthood in 
order to understand which assets are most important to adolescent de- 
velopment and which patterns of assets are linked to particular types of 
successful adult transitions in various cultural contexts. 

□ Despite its limitations, research in all settings in the lives of ado- 
lescents — families, schools, and communities — is yielding consistent evi- 
dence that there are specific features of settings that support positive 
youth development and that these features can be incorporated into com- 
munity programs 

□ In the committee’s judgment, current evidence supports the repli- 
cation of a few specific integrated programs for positive youth develop- 
ment: the Teen Outreach Program, Big Brothers, Big Sisters, and Quan- 
tum Opportunities are three prime examples. 
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Very few integrated programs have received the kind of comprehen- 
sive experimental evaluation necessary to make a firm recommendation 
about replicating the program in its entirety across the country. How- 
ever, there is sufficient evidence from a variety of sources to make recom- 
mendations about fundamental principles of supportive developmental 
settings and some specific aspects of programs that can be used to design 
community programs for youth. These are captured by the features of 
supportive settings outlined in Table ES-1. 

Recommendation 5 — Federal agencies that fund research on adoles- 
cent health, development, and well-being, such as the Department of 
Health and Human Services, the Department of Justice, and the Depart- 
ment of Education, should build into their portfolios new or more com- 
prehensive longitudinal and experimental research on the personal and 
social assets needed to promote the healthy development and well-being 
of adolescents and to promote the successful transition from childhood 
through adolescence and into adulthood. 

Recommendation 6 — Public and private funders should support re- 
search on whether the features of positive developmental settings identi- 
fied in this report are the most important features of community pro- 
grams for youth. This research should encourage program design and 
implementation that meets the diverse needs of an increasingly heteroge- 
neous population of youth. 



Program Evaluation 

Evaluation and ongoing program study can provide important in- 
sights to inform program design, selection, and modification. Program 
evaluation can also help funders and policy makers make informed 
choices about which programs to fund for which groups of youth. The 
desire to conduct high-quality evaluation can help program staff clarify 
their objectives and decide which types of evidence will be most useful in 
determining if these objectives have been met. Ongoing program study 
and evaluation can also be used by program staff, program participants, 
and funders to track program objectives; this is typically done by estab- 
lishing a system for ongoing data collection that measures the extent to 
which various aspects of the programs are being delivered, how are they 
delivered, who is providing these services, and who is receiving these 
services. Such information can provide useful information to program 
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staff to help them make changes to improve program effectiveness. Finally, 
program evaluation can test both new and very well developed program 
designs by assessing the immediate, observable results of the program 
outcomes and benefits associated with participation in the program. 

Such summative evaluation can be done in conjunction with strong 
theory-based evaluation or as a more preliminary assessment of the po- 
tential usefulness of novel programs and quite complex social experi- 
ments in which there is no well-specified theory of change. In other 
words, program evaluation and study can help foster accountability, 
determine whether programs make a difference, and provide staff with 
the information they need to improve service delivery. 

Clearly there are many purposes for evaluation. Not surprisingly 
then, there are different opinions among service practitioners, research- 
ers, policy makers, and funders about the most appropriate and useful 
methods for evaluating community programs for youth. In part, these 
disagreements reflect different goals and different questions about youth 
programs. They also reflect philosophical differences about the purposes 
of evaluation and nature of program development. Program prac- 
titioners, policy makers, program evaluators, and others studying pro- 
grams should decide exactly which questions they want answered before 
deciding on the most appropriate methods. The most comprehensive 
experimental evaluation, which involves assessment of the quality of 
implementation as well as outcomes, is quite expensive and involves a 
variety of methods. It also provides the most comprehensive informa- 
tion regarding both the effectiveness of specific programs and the rea- 
sons for their effectiveness. 



Conclusions 

□ Very few high-quality comprehensive experimental evaluations of 
community programs for youth have adequately assessed the impact of 
the programs on adolescents. 

□ Some high-quality experimental and quasi-experimental evalua- 
tions show positive effects on a variety of outcomes, including both in- 
creases in the psychological and social assets of youth and decreases in 
the incidence of such problem behaviors as early pregnancy, drug use, 
and delinquency. 

□ Experimental designs are still the best method for estimating the 
impact of a program on its participants and should be used when this is 
the goal of the evaluation. 
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Comprehensive program evaluation is an even better way to gather 
complete information about programs. It requires asking a number of 
questions through various methods. The committee identified six funda- 
mental questions that should be considered in comprehensive evalua- 
tions: 

° Is the theory of the program that is being evaluated explicit and 
plausible? 

° How well has the program theory been implemented in the sites 
studied? 

© In general, is the program effective and, in particular, is it effec- 
tive with specific subpopulations of young people? 

° Whether it is or is not effective, why is this the case? 

© What is the value of the program? 

° What recommendations about action should be made? 

All six questions may not be answered well in one study; several 
evaluative studies may be needed to address these questions. Thus com- 
prehensive experimental evaluation can be quite expensive and time-con- 
suming — but provides the most information about program design, as 
well as fundamental questions about human development. Thus, it is 
particularly useful to both the policy and research communities, as well 
as the practice community. 

In order to generate the kind of information about community pro- 
grams for youth needed to justify large-scale expenditures on programs 
and to further fundamental understanding of the role of community pro- 
grams in youth development, comprehensive experimental program 
evaluations should be used when: 

© the object of study is a program component that repeatedly oc- 
curs across many of the organizations currently providing com- 
munity services to youth; 

° an established national organization provides the program being 
evaluated through many local affiliates; and 

° theoretically sound ideas for a new demonstration program or 
project emerge, and pilot work indicates that these ideas can be 
implemented in other contexts. 

Comprehensive experimental evaluations are not appropriate for 
newer, less established programs or programs that lack a well-articulated 
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theory of change underlying the program design. A variety of non- 
experimental methods, such as interviewing, case studies, and observa- 
tional techniques, and more focused experimental and quasi-experimen- 
tal studies are ways to understand and assess these types of community 
programs for youth. Although the nonexperimental methods tell us less 
about the effectiveness of particular community programs than experi- 
mental program evaluations, they can, when carefully implemented, pro- 
vide information about the strengths and weakness in program imple- 
mentation and can be used to identify patterns of effective practice. They 
are also quite helpful in generating hypotheses about why programs fail. 

Programs that meet the following criteria should be studied through 
nonexperimental or more focused experimental and quasi-experimental 
methods, depending on the goals of the evaluation: 

© An organization, program, project, or program element that has 
not matured sufficiently in terms of its philosophy and implemen- 
tation; 

© The evaluation has to be conducted by the staff of the program 
under evaluation; 

° The major questions of interest pertain to the quality of the pro- 
gram theory, the implementation of that theory, or to the nature 
of its participants, staff, or surrounding context; 

© The program is quite broad, involving multiple agencies in the 
same community; and 

© The program or organization is interested in reflective practice 
and continuing improvement. 

Whether experimental or nonexperimental methods are used, high- 
quality, comprehensive evaluation is important to the future develop- 
ment and success of community programs for youth and should be used 
by all programs and youth-serving organizations. 

Recommendation 7 — All community programs for youth should 
undergo evaluation — possibly multiple evaluations — to improve design 
and implementation, to create accountability, and to assess outcomes 
and impacts. For any given evaluation, the scope and the rigor should be 
appropriately calibrated to the attributes of the program, the available 
resources, and the goals of the evaluation. 
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Recommendation 8 — Funders should provide the necessary funds for 
evaluation. In many cases, this will involve support for collaborative 
teams of researchers, evaluators, theoreticians, policy makers, and prac- 
titioners to ensure that programs are well designed initially and then 
evaluated in the most appropriate way. 



Over the past decade, social indicator data and technical assistance 
resources have become increasingly important tools that community pro- 
grams can employ to support every aspect of their work — from initial 
planning and design, to tracking goals, program accountability, target- 
ing services, reflection, and improvement. There are now significant data 
and related technical assistance resources to aid in understanding the 
young people involved in these programs. Community programs for 
youth benefit from ready access to high-quality data that allow them to 
assess and monitor the well-being of youth in their community, the well- 
being of youth they directly serve, and the elements of their programs 
that are intended to support those youth. They also benefit from infor- 
mation and training to help them use these data tools wisely and effec- 
tively. 

Conclusion 

□ Even when exploited to their full potential, administrative, vital 
statistics, and related data sources can cover only limited geographic ar- 
eas and only some components of a youth development framework. 
Adding local survey data in diverse communities, as has been done in a 
number of states and individual communities, can help create a more 
complete picture. 

Community programs for youth are interested in building their ca- 
pacity to assess the quality of their programs. To produce useful process 
evaluations, performance monitoring, and self-assessment, however, pro- 
gram practitioners need valid, reliable indicators and measures of the 
developmental quality of the experiences they provide. Such informa- 
tion would also facilitate the ability of communities to monitor change 
over time as new program initiatives are introduced into the community. 
If communities know how their youth are doing on a variety of indica- 
tors for an extended period of time both before and after a new program 
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is introduced, they can use this information as preliminary evidence that 
their program is effective. Such inferences are strengthened if informa- 
tion on the same indicators is available in comparable communities that 
did not introduce that program at the same time. Research is needed to 
determine whether appropriate indicators vary depending on the charac- 
teristics of the specific youth population served by a program and as 
understanding of the determinants of positive youth development im- 
proves, these indicators should be periodically revisited and, if necessary, 
revised. 

Many community programs also lack staff knowledge and the funds 
to take full advantage of social indicators as tools to aid in planning, 
monitoring, assessing, and improving program activities. Individual pro- 
grams and communities would benefit from opportunities to improve 
their capacity to collect and use social indicator data. 

Recommendation 9 — Public and private funders should support the 
fielding of youth development surveys in more states and communities 
around the country; the development, testing, and fielding of new youth 
development measures that work well across diverse population sub- 
groups; and greater coordination between measures used in community 
surveys and national longitudinal surveys. 

Recommendation 10 — Public and private funders should support 
collaboration between researchers and the practice community to de- 
velop social indicator data that build understanding of how programs 
are implemented and improve the ability to monitor programs. Collabo- 
rative efforts would further the understanding of the relationship between 
program features and positive developmental outcomes among young 
people. 

Recommendation 11 — Public and private funders should provide 
opportunities for individual programs and communities to increase their 
capacity to collect and use social indicator data. This requires better 
training for program staff and more support for national and regional 
intermediaries that provide technical assistance in a variety of ways, in- 
cluding Internet-based systems. 
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CHAPTER 1 



Setting the Stage 



A ll adolescents, in all economic and social circumstances, 
need generous amounts of help, instruction, discipline, sup- 
port, and caring as they make their way from childhood 
through adolescence and into adulthood. Such assistance 
comes from many sources: solid families, good schools, 
supportive and safe neighborhoods, and a surrounding 
culture that emphasizes constructive lives and respectful 
relationships. 

Community programs for youth, found in many neigh- 
borhoods in America, provide these sources of support. 
They exist in many forms: special clubs and service pro- 
grams, sports leagues, community service organizations, 
faith-based youth groups, academic enrichment programs, 
music lessons, and many others. They are identified by a 
vast array of terms — after-school programs, youth clubs, 
youth development programs, or programs during non- 
school hours or out-of-school time. 

Many such groups have been around for decades. 
They range from well-known national organizations with 
long histories — for example, Little League, Boy Scouts and 
Girl Scouts, Campfire U.S.A., YMCAs and YWCAs, and 
4-H Clubs — to countless smaller groups and organizations 
that may be only a few years old and whose names are 
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known only to the teens and families who participate in them — for ex- 
ample, programs that teach swimming and lifesaving run by a neighbor- 
hood community center, a series of studio art classes offered by a local 
museum for talented young artists, and math and computer enrichment 
programs for middle school youth sponsored by a local business. 

GROWING SUPPORT FOR PROGRAMS 

Increased funding from diverse federal agencies, foundations, state 
and local governments, and the private sector has expanded the avail- 
ability of such programs. For example, in 2000 Congress appropriated 
$453 million (an amount that increased to $846 million in 2001) to 
enable schools and school districts to provide after-school programs des- 
ignated as 21st Century Learning Centers. Private philanthropic founda- 
tions have also rapidly expanded their support of community programs 
for youth. At the same time, a variety of youth-serving organizations, 
research institutions, technical assistance organizations, and funders have 
been working, both together and independently, to create frameworks 
for thinking about positive youth development (e.g., Public/Private Ven- 
tures, Chapin Hall Center for Children, the Academy for Educational 
Development, the National Collaboration for Youth, the National Youth 
Development Information Center, and the International Youth Founda- 
tion). Others have developed studies and frameworks for understanding 
how much of adolescents’ time is unstructured and potentially available 
for programmatic activities (Pittman et al., 2000c). However, exactly 
what should fill that time is still being debated. Some would like to see 
it used primarily for educational remediation and skill acquisition; others 
would like to see it used primarily for prevention-focused activities; 
others argue that it should be used to promote positive development in 
the fullest sense; and still others express concern that children and ado- 
lescents need this time to relax and do the things they want to do with 
minimal adult-structured activities. Many programs have been designed 
and implemented across the country — only some of which are being 
evaluated. Efforts have been made to develop a more integrated, system- 
atic perspective on how best to provide learning and growth-promoting 
activities for children and youth. 

At the same time, there is evidence of increasing public conviction 
that organized programs during after-school hours can prevent problem 
behavior in children and adolescents as well as promote their health, 
development, and well-being. Polls of parents, educators, other adults in 
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the community, and young people themselves indicate increasing endorse- 
ment for improving the supply, quality, and access to after-school pro- 
grams: 



° In one survey of the voting public, 93 percent of respondents fa- 
vored making safe daily enrichment programs available to all chil- 
dren; 86 percent thought that organized after-school activities 
were a necessity; only 1 1 percent thought they were not necessary 
(Charles Stewart Mott Foundation, 1998b); 

° In a second survey, 84 percent of elementary school principals 
responded that there was a need for supervision both before and 
after school in their communities. The teachers surveyed singled 
out the need for after-school programs as critical to helping stu- 
dents with difficulties (Metropolitan Life, 1994); 

° In a third survey, children and adolescents reported that they want 
constructive activities outside school, safe places to go where they 
can prepare for their future, learn and practice new skills, and 
spend quality time with caring adults and other children and ado- 
lescents (Quinn, 1999). 

ADOLESCENT DEVELOPMENT 

Perhaps more important than the increased interest in and funding 
of community youth organizations, however, has been the focus of com- 
munity programs on goals related to positive youth development, as well 
as the prevention and reduction of problem behavior. In the early 1990s, 
a couple of seminal reports on adolescent development and the role of 
youth organizations attracted the attention of policy makers, youth ser- 
vice practitioners, researchers, educators, and families. The Forgotten 
Half ] published by the William T. Grant Foundation, urged Americans 
to recognize that young people’s experiences at home, at school, in the 
community, and at work are strongly interconnected and argued that all 
young people need more constructive contact with adults; opportunities 
to participate in valued community activities; special help with difficult 
problems; and initial jobs that offer a path to accomplishment (William 
T. Grant Commission on Work, Family and Citizenship, 2000). This 
report also stressed the fact that poor children and children not headed 
for college were being severely underserved in terms of programs and 
opportunities that could support positive development and preparation 
for adulthood. 
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This was followed in 1992 by A Matter of Time, a Carnegie Council 
on Adolescent Development report that observed that individuals de- 
velop through connection with a variety of people and systems. The 
report underscored the broad theoretical and empirical support for the 
essential role of community programs in promoting young people’s 
healthy development (Carnegie Corporation of New York, 1992). It 
also stressed: (1) the growing need for such programs, given the com- 
plexity of life in the United States and the growing ambiguity about how 
best to prepare for a rapidly changing adult landscape, and (2) the pau- 
city of high-quality community programs, especially for youth living in 
high-risk neighborhoods. 

Numerous other reports and books have stressed the growing com- 
plexity of adolescent development. Not that long ago, adolescence ended 
somewhere between 18 and 22 — at which point young adults moved 
into the labor market, married, and began their families. As recently as 
the 1960s, the transition into adulthood in most Western industrialized 
countries (particularly in the United States and Canada) was well defined 
for most social class groups. Adolescents finished high school and either 
went to college or into the labor market or the military. People generally 
married and began families in their early 20s. People were thus usually 
launched into adulthood by their early 20s, and there were only a limited 
number of fairly well-defined pathways from adolescence into adulthood 
(Arnett, 2000b). 

This is no longer the case (Brown and Corbett, in press; Arnett, 
2000b; Mortimer and Larson, 2002). Rapid demographic, sociocultural, 
and labor market changes have extended adolescence well into the 20s. 
The median age for marriage and childbearing has moved up to the late 
20s. Both the length of time and numbers of youth involved in some 
form of postsecondary education have increased dramatically. Finally, 
the heterogeneity of passage through this period of life has exploded. 
There is no longer a small, easily understood set of patterns for the tran- 
sition to adulthood. The future job market is unclear because it is chang- 
ing so rapidly; youth are being advised to expect as many as four quite 
different occupational careers. The likelihood of today’s youth moving 
into jobs similar to those held by their parents or other adult mentors has 
decreased substantially over the last 50 years, as has the likelihood that 
they will live in the same communities in which they grew up, and the 
likelihood that they will form a permanent intimate partnership with one 
other person and raise a family with that person (Elder and Conger, 
2000; Giddens, 1990, 1992; Gleick, 1999; Larson, in press). 
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In the United States, the level of challenge for adolescents is espe- 
cially high for noncollege-bound youth and for members of several eth- 
nic minority groups, particularly blacks and Hispanics, for at least two 
reasons: (1) unlike many European and Asian industrialized countries, 
there is very little institutional support for the transition from secondary 
school to work in the United States, creating what the W.T. Grant Foun- 
dation labeled a “floundering” period (W.T. Grant Commission on 
Work, Family and Citizenship, 2000; see also Rosenbaum et al., 1992) 
and (2) stereotypes about the competence of blacks and Hispanics, 
coupled with lower levels of “soft skills” (e.g., the ability to communi- 
cate effectively, resolve conflicts, and prepare for and succeed in a job 
interview) (Murnane and Levy, 1996) and the loss of employment options 
in many inner-city communities (Wilson, 1987), have made employment 
for these youth (particularly males) quite problematic. 

Coupled with these changes in the complexity of the adult world 
into which today’s youth will be moving are the widespread risks con- 
fronting them. In the United States, the use of and access to drugs and 
alcohol has increased. Nearly 90 percent of 10th graders and 75 percent 
of 8th graders think that alcohol is either “fairly easy” or “very easy” to 
get (National Institute on Drug Abuse, 1996). “Rave drugs,” such as the 
synthetic psychoactive drug called ecstasy, have become popular at night- 
clubs, rock concerts, and late-night parties, particularly in urban and 
suburban neighborhoods and among white middle-class young adults. 
Ecstasy has become the most frequently mentioned drug in telephone 
calls to the Poison Control Center (Partnership for Family Involvement, 
2000). A review of top-selling popular songs found alcohol mentioned 
in 47 percent of rap music lyrics (Roberts et al., 1999). In recent televi- 
sion programs, 9 out of 10 drinkers of alcohol are portrayed as either 
experiencing no effects at all or only positive personal and social out- 
comes from their alcohol consumption (Gerbner, 1996). 

Adolescents are surrounded by a culture of violence. In America, 
young people are being exposed to increasing amounts of media vio- 
lence, especially in television, movies, video games, and youth-oriented 
music. By age 18, the average young person will have viewed an esti- 
mated 200,000 acts of violence on television alone (Huston et al., 1992). 
Youth gangs have grown considerably in the last two decades. The inci- 
dence of gangs in schools has almost doubled from 1989 to 1995 (Howell 
and Lynch, 2000). This presence of gangs in schools has been linked 
with increased gun possession among adolescents; students reported 
knowing a classmate who has brought a gun to school at a higher per- 
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centage (25 percent) when gangs were present in the schools than when 
gangs are not present (8 percent) (Howell and Lynch, 2000). According 
to a recent report issued by the U.S. Department of Education, over 6,000 
students were expelled in the 1996-1997 school year for bringing guns to 
their public school (American Bar Association, 2000). 

Programs for young people to combat these negative trends may be 
helpful. The idea of “positive youth development programs” has 
emerged over time as common shorthand for a philosophy asserting that 
“problem-free is not fully prepared,” that remediation and prevention 
services alone are not enough, and that schools have to be supported and 
complemented by broader options in the community (Pittman and Irby, 
1996; Pittman et al., 2000b). 

COMMITTEE CHARGE 

Stimulated by the growing national interest in the link between posi- 
tive adolescent development and community programs, the National 
Academies formed the Committee on Community-Level Programs for 
Youth with support from a consortium of federal agencies and private 
foundations. The committee is an interdisciplinary group of individuals 
with expertise in a range of relevant fields, including child and adoles- 
cent development, maternal and child health, sociology, psychology, an- 
thropology, economics, public policy, statistics, evaluation research, 
youth service programs, urban planning, and community development. 
The committee was asked to summarize the rapidly expanding body of 
research on community interventions and programs designed to promote 
positive outcomes for adolescent development. It was asked to assess 
the strengths and limitations of data sources and indicators commonly 
used to characterize youth health, development, and well-being, as well 
as to assess the strengths and limitations of methodologies and ap- 
proaches used to evaluate these activities. The committee was asked to 
identify gaps and central questions for the design of a unified conceptual 
framework and research agenda to promote the healthy development of 
youth. And the committee was asked to identify, to the extent feasible, 
programs with sufficiently strong evidence to suggest that they could 
serve as models for communities that are expanding their youth 
programs. 



Setting the Stage 



25 



YOUTH IN THE UNITED STATES: A MIXED PICTURE 

The committee began its work by looking closely at the behaviors, 
needs, and circumstances of adolescents in the United States. We recog- 
nized from the beginning that the health and well-being of young people 
across the country is uneven. Some are doing quite well; others are doing 
very poorly. 



Some Good News 

The current cohort of adolescents presents a confusing mix of good 
and bad news. The good news is very good indeed — many measures of 
adolescent well-being and behavior have shown significant progress over 
the past 20 years. 

More youth than ever are graduating from high school, and a large 
number are enrolled in some form of higher education (Ekston et al., 
1987). High school dropout rates, although still unacceptably large for 
some population subgroups, are at all-time lows (National Campaign to 
Prevent Teen Pregnancy, 2001; Ekston et ah, 1987). 

In 1998, the rate for serious violent crimes committed by juveniles 
had dropped by more than half since 1993 and was the lowest it had 
been since the first data collection efforts in 1973 (U.S. Department of 
Health and Human Services, 1999). From 1991 to 1997 the percentage 
of students in grades 9 through 12 who reported carrying a weapon at 
least once in the past month declined from 26 to 18 percent (U.S. Depart- 
ment of Health and Human Services, 1999). 

Between 40 and 50 percent of high school seniors report having par- 
ticipated in a volunteer or community-based service program at least a 
few times in the previous year (Institute for Social Research, 1999). 

In 1999, 70 percent of high school students reported engaging in 
vigorous physical activity in the previous week, and over half of all high 
school students were enrolled in high school physical education classes 
(Centers for Disease Control and Prevention, 2000b). The use of illicit 
drugs by youth ages 12 to 17 has declined over the past three years, from 
a high of 11 percent in 1997 to 9 percent in 1999 (U.S. Department of 
Health and Human Services, 1999). Sexual activity has, on average, 
declined among teens and contraceptive use has increased (National 
Campaign to Prevent Teen Pregnancy, 2001). Furthermore, the overall 
rate of babies born to adolescents dropped by a third between 1991 and 
1998, and in 1998 the birth rate for 15- to 17-year-olds was the lowest 
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it has been in over 40 years (U.S. Department of Health and Human 
Services, 1999). 



Continuing Problems 

Nonetheless, some social indicators suggest continuing problems for 
many young people, particularly some specific subsets of them. 



Academic Failure 

Although the gap between white and black students’ achievement on 
the National Assessment of Educational Progress tests has narrowed 
somewhat since 1973, there are still substantial racial and ethnic group 
differences in performance on these tests. In addition, youth from poor 
inner-city and rural areas are doing substantially worse on these tests 
than youth from more affluent school districts (Campbell et al., 2000; 
Jencks and Phillips, 1998). Youth in poor inner-city areas lose a sub- 
stantial portion of their school-year academic achievement gains over the 
summer months — perhaps due to fewer learning opportunities, less sup- 
port for learning in the home, and limited quality and quantity of parent 
interaction — leaving them farther behind their more affluent peers at the 
start of each new school year than they were at the end of the previous 
one (Entwisle and Alexander, 1992). The proportion of young people 
dropping out without completing high school increases with age and is 
particularly high among Hispanic youth and adolescents living in poor 
communities (National Center for Health Statistics, 2000). Finally, in 
the most recent comparative international academic achievement tests, 
U.S. youth scored substantially lower on tests of both mathematical and 
scientific knowledge than youth in most other industrialized countries 
(National Center for Education Statistics, 1995). 



Poor Physical and Mental Health 

Some teens are still becoming sexually active quite young: 8 percent 
of students reported having had sex before age 13 — a disturbing 15 percent 
increase between 1988 and 1995 (National Center for Health Statistics, 
2000; National Center for Chronic Disease Prevention and Health Pro- 
motion, 1999). The rates of sexual activity were particularly high among 
black youth living in poor communities (Blum et al., 2000; National 
Center for Health Statistics, 2000). And although most teens (88 per- 
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cent) said they thought it was important to use contraception each and 
every time they had sex, 30 percent of girls reported having been com- 
pletely unprotected the last time they had sex, and between 30 and 38 
percent of teens who used contraception did so inconsistently (National 
Campaign to Prevent Teen Pregnancy, 2000). Furthermore, rates of sexu- 
ally transmitted diseases and both HIV and AIDS were alarmingly high 
among adolescents in general, and particularly high among black and 
American Indian youth living in poor communities (National Center for 
Health Statistics, 2000). In fact, half of all new HIV infections occurred 
among people under the age of 25, and one-quarter of new infections 
occurred among people between the ages of 13 and 21 (Kirby, 1998). 

Smoking among teens in 2000 had declined since its peak in 1996, 
following a dramatic 50 percent increase since 1991. However, smoking 
is still quite high among youth. Nearly 63 percent of adolescents have 
tried cigarettes by the 12th grade, and 31 percent are currently frequent 
smokers (Federal Interagency Forum on Child and Family Statistics, 
2000). Smoking rates among white and Hispanic young people are also 
notably higher than among black youth (Centers for Disease Control 
and Prevention, 2000b). Binge drinking is also quite high, particularly 
among white and Hispanic youth (National Center for Health Statistics, 
2000; Blum et al., 2000). 

The daily participation of adolescents in high school physical educa- 
tion classes dropped from 42 percent in 1991 to 27 percent in 1997 
(Centers for Disease Control and Prevention, 2000b). The overall preva- 
lence of obesity among adolescent 12- to 19-year-olds in the United States 
more than doubled in 34 years — increasing from 5 percent in 1965 to 14 
percent in 1999 (National Center for Health Statistics, 1999). And, from 
1988 to 1994, approximately 11 percent of 12- to 17-year-olds were 
seriously overweight (National Center for Health Statistics, 2000). Of 
the youth surveyed in the National Longitudinal Study of Adolescent 
Health (called Add Health), 13 percent (representing 2.5 million U.S. 
youth) reported having had suicidal thoughts or had attempted suicide in 
the previous 12 months. White, Hispanic, female, and poor youth were 
the most likely to report these thoughts and behaviors (Blum et al., 2000; 
National Center for Health Statistics, 2000). 



Violent Behavior 

In 1997, homicide was the second leading cause of death for young 
people ages 15 to 24; it was the leading cause of death among black 
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youth and the second leading cause of death for Hispanic youth (Na- 
tional Center for Injury Prevention and Control, 2000). Of the youth 
surveyed in the most recent wave of the Add Health study, 26 percent 
reported having been involved in weapon-related violence in the past 12 
months. Black and Hispanic youth living in poor communities were the 
most likely to report these experiences (Blum et ah, 2000). Between July 
1992 and June 1994, 105 violent deaths occurred on or near school 
grounds or at school-related events. Firearms were used in 77 percent of 
these deaths (National Center for Injury Prevention and Control, 2000). 
There was an increasing number of highly publicized incidences of gun 
violence on school campuses in 2000 and 2001, in places such as 
Jonesboro, Arkansas; Columbine, Colorado; and Santee, California. 



Poor Economic and Family Circumstances 

An ever-increasing proportion of teenagers were living some or all of 
their adolescent years in single-parent homes. Since 1980 the percentage 
of young people living in single-parent households rose from 7 percent in 
1980 to 27 percent in 1999. Despite the recent booming economy, 18 
percent of youth under 18 lived in households below the poverty level in 
1998. Among minority adolescents, the picture is even bleaker. When 
poverty is combined with living in a single-parent household, minority 
youth are at particular risk for all of the problems outlined in this section 
(Federal Interagency Forum on Child and Family Statistics, 2000). 



Adolescent Use of Time 

There is evidence that how young people spend their out-of-school 
time influences their health and well-being. 

Compared with young people in both Europe and Asia, teens in the 
United States have more discretionary time — only about 20 percent of 
adolescents’ hours are spent in school. They spend limited time on 
schoolwork; much of their discretionary time is spent watching televi- 
sion (especially by young adolescents, boys, youth from low socioeco- 
nomic environments, and black youth) or “hanging out” with friends 
(Larson and Verma, 1999; Zill et al., 1995). In addition, there are 
approximately 8 million children, ranging from ages 5 to 14 who spend 
time without any kind of supervision during nonschool hours. And their 
numbers increase as children get older. Unsupervised time can account 
for approximately 20-25 hours per week (National Institute on Out-of- 
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School Time, 2001a). A variety of factors, including rising child care 
costs, increased work hours, welfare reform, and the limited availability 
of good programs may account for the large number of children left 
alone during nonschool hours. 

Being alone during nonschool hours invites problems. This is not a 
new thought: recall the adage: “idle hands are the devil’s workshop.” 
Filling empty hours, of course, can be overdone, and there is merit in 
offering young people unhurried blocks of time to think, play, have fun, 
talk to parents and friends, and even read for pleasure. However, there 
is evidence that teens left alone during nonschool hours are more likely 
to engage in sexual intercourse, alcohol or drug abuse, smoking, vio- 
lence, and gang-related behavior (Zill et al., 1995). Others simply use 
this unstructured time to play video games. Some experience fear and 
anxiety when left at home by themselves. 

A study of 5,000 8th grade students in the San Diego and Los Ange- 
les areas found that children left home alone, regardless of race, sex, or 
economic status, are more likely to drink alcohol or take drugs than 
children who are supervised by a parent or another adult. And the more 
hours they were left by themselves, the greater their risk (Richardson et 
al., 1989). Similar results have been reported by Marshall et al. (1997) 
and the YMCA (2001). 

There is also evidence that participation in “constructive learning 
activities” during nonschool hours may predict success or failure in 
school. Reginald Clark’s work (1983, 1988) suggests that participating 
in such activities as leisure reading and writing, music, chores, home- 
work, or problem-solving games creates opportunities for young people 
to enhance their cognitive skills and extend their learning. In contrast, 
young people who do not have the opportunity to participate in these 
kinds of activities or who engage in excessive hours of unstructured 
activities (e.g., television, video games, hanging out with friends) tend to 
underachieve in school. 



Participation in Community Programs 

What these data mean in the context of this report is that a signifi- 
cant number of young people — particularly those who are poor and live 
in high-risk neighborhoods — are in particular need of support. Such youth 
are disproportionately likely to be members of racial and ethnic minority 
groups. Community programs for youth are being looked on as one way 
to redress the social inequities that currently confront America. 
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Studies indicate that participation in voluntary structured activities 
during nonschool time is associated with development of positive iden- 
tity, increased initiative, and positive relationships with diverse peers and 
adults, better school achievement, reduced rates of dropping out of 
school, reduced delinquency, and more positive outcomes in adulthood 
(Barber et al., in press; Clark, 1988; Eccles and Barber, 1999; Larson, 
2000; Vandell and Posner, 1999). For example, in the National Longi- 
tudinal Survey of Youth, students who reported spending no time in 
some kind of school-sponsored activity (versus those spending 1 to 4 
hours per week in such activities) were 57 percent more likely to have 
dropped out before they reached the 12th grade. Also, students with 
high levels of participation in school activities were less likely than non- 
participants to engage in problem behavior, such as being arrested, tak- 
ing drugs, engaging in teen sex, smoking, and drinking (Zill et al., 1995). 

In recent community-based surveys conducted by the Search Insti- 
tute (Benson, 1997; Scales and Leffert, 1999) and by Sipe and colleagues 
for Public/Private Ventures (Sipe et al., 1998), a substantial number of 
young people were not involved in programs during their out-of-school 
time. For example, less than 25 percent of youth in low-income commu- 
nities in Austin, Texas, St. Petersburg, Florida, and Savannah, Georgia, 
reported having been involved in any formal leadership activities in the 
previous year (Sipe et al., 1998; Scales and Leffert, 1999). The commu- 
nities included in this survey were chosen to represent communities with 
high crime rates, low rates of school performance, and high unemploy- 
ment. In another survey, with a more representative sample from across 
the United States, similar results were found; only 50 percent of the youth 
in public and alternative schools, surveyed from over 213 different towns 
and cities across the United States by the Search Institute, spent even 3 
hours per week in constructive out-of-school activities (Scales and Leffert, 
1999). Finally, according to an analysis of national survey data collected 
for the committee by the Urban Institute and Child Trends, 60 percent of 
youth did not participate in any kind of community-based youth activity. 
Of the few that were involved, about 20 percent participated less than an 
hour a day, leaving about half of the youth between 12 and 14 years of 
age not taking part in any kind of extra-curricular class or lesson. Re- 
search from the National Longitudinal Survey of Youth (U.S. Depart- 
ment of Labor, 1997) echoes these findings, with only about a fifth of 
teenagers in the United States in the late 1980s and 1990s having partici- 
pated in some kind of structured out-of-school activity. 

The prevailing problem regarding participation in after-school com- 
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munity programs seems to be one of unmet need. The number of youth 
left without some kind of after-school programming now exceeds 11 
million (Newman et ah, 2000). While not all young people want or need 
such programs, this number is probably some indication of unmet need. 
And, adolescents from low- to moderate-income working families are 
the least likely to have access to programs because of financial and trans- 
portation constraints (Newman et al., 2000). Among grantees of the 
federally funded 21st Century Learning Centers, 40 percent report that 
they have long waiting lists for youth to get into programs (U.S. Depart- 
ment of Education, 2000). The U.S. General Accounting Office esti- 
mated that in the year 2002, the current number of school-age child care 
programs will meet as little as 25 percent of the demand in some urban 
areas (U.S. General Accounting Office, 1997). Over half of the teens 
polled by the YMCA (2001) said they wished there were more after- 
school programs in their community. More than half (54 percent) said 
they would not watch so much television or play video games if they had 
other things to do after school. 

Nevertheless, it is clear that community programs for young people 
cannot bear the full weight and responsibility for producing healthy, ro- 
bust future generations. They may help, but no program can fully com- 
pensate for a dysfunctional family, poor schools, chaotic neighborhoods, 
poor medical care, environmental toxins, and stress-filled early lives, 
particularly given that many, perhaps most community programs for 
youth are small and fragile, with unstable funding and questionable fu- 
tures. Expectations should not therefore be excessive or naive, even for 
the best and strongest model programs. 

SCOPE OF THE STUDY 
Program Characteristics 

One hurdle faced by the committee was developing a common un- 
derstanding of what constitutes a community program for youth. The 
characterization of these programs is complicated, and the landscape is 
vast. They may be called after-school programs, youth programs, youth 
activities, youth development programs, community programs, extracur- 
ricular activities, or programs during out-of-school time or nonschool 
hours. In addition, we debated whether school programs should be in- 
cluded, since schools in the United States are, for the most part, locally 
controlled. We also debated what constitutes a community. 
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Rather than thinking of such programs in certain categories — such 
as those that focus on sports or academics or those that are faith-based 
or school-based or recreational center-based — we decided that it would 
be more useful to see programs as arrayed along a continuum and to be 
generous in our definition of community. At one end are small, infor- 
mal, and unaffiliated programs, typically only marginally funded by pub- 
lic dollars, that touch the lives of relatively few teenagers. At the other 
end are the large, often national programs that may have many state and 
local-level franchises, enroll sometimes millions of young people, have 
large and relatively stable budgets (often including substantial public 
dollars), and involve many adults in various capacities ranging from 
membership on a national board to service as volunteers in a particular 
program. In the context of this report, communities include neighbor- 
hoods, block groups, towns, and cities as well as nongeographically 
defined communities based on family connections and shared interests or 
values. 

The committee also decided to look at programs and the organiza- 
tions operating them in terms of the developmental needs the program is 
attempting to fill, rather than the particular structural form they have 
taken. This perspective stems from our view that young people have a 
number of fundamental needs — including, for example, the need for af- 
filiation, friendship, and belonging to a group and the need to feel com- 
petent, efficacious, respected, and significant — and that they will seek 
ways to meet these needs in a variety of places and situations. Some of 
the possible places and situations can increase the likelihood of develop- 
mental pathways that include antisocial behaviors, such as joining a gang; 
others can increase the likelihood of developmental pathways rich in 
positive social (prosocial) and health-promoting behaviors, such as join- 
ing a community service group or a prosocial peer network. Community 
programs are therefore best seen and described from the perspective of 
how they are addressing what teenagers need and how these needs may 
change over the years of adolescence. In developing this report, we be- 
gan by discussing what current research, theory, and practice show that 
young people require from their immediate environments as they grow 
toward young adulthood (see especially Chapters 2, 3, and 4). We then 
looked at individual programs and their evaluations through this lens 
(see especially Chapters 5 and 6). 

Equally important is the question of what role these programs play 
in the lives of young people. Are they extensions of school? Are they 
merely luxuries for some families, or are they essential for healthy devel- 
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opment for all adolescents? Are they simply efforts to fill empty hours 
while parents are at work — even serving as a kind of babysitter? Our 
answer to these questions is that community programs should be pur- 
poseful, voluntary activities designed to offer concrete benefits to all the 
young people enrolled in them. Although they may indeed keep young 
people occupied while their parents are at work, their goal is not to 
simply fill up time but rather to support positive development during 
adolescence in specific ways that also help prepare youth for adulthood. 
As such, these programs and organizations should, and do, complement 
and support the primary nurturing and teaching roles of the family and 
the academic mission of the schools. Many of the best-regarded pro- 
grams craft explicit links with both home and school. Some of the pro- 
grams we reviewed even take place during the normal school hours in the 
school building itself. 

Moreover, there is no question that some programs are organized to 
provide a modest counterweight to popular youth culture, which some 
see as toxic and damaging to young people. For example, some, seeing 
the current youth culture as misogynistic, organize programs for young 
men to encourage them to be respectful of young women and programs 
for young women to understand how current popular culture demeans 
them. Others offer both young women and men programs that teach 
them techniques to resist cultural pressures to become sexually active at 
an early age, to use illicit drugs, and to join gang activities. And still 
others include “media literacy” training that attempts to teach young 
people to become critical, discerning consumers of media. Thus, in such 
instances, community programs are not so much filling gaps left by fami- 
lies and schools, but rather trying to counteract broader cultural influ- 
ences perceived to be harmful. 

Discussion of whether or not to include school-based programs oc- 
cupied a significant portion of the committee’s early deliberations. Al- 
though there are often fundamental structural, budgetary, and organiza- 
tional differences between school-based and other programs, the function 
and potential impact of these programs are more similar than they are 
different. In our view, the examination of youth programs operating in 
schools and taking a positive youth development approach yet are inde- 
pendent of the schools’ instructional activities is necessary in order to 
provide a complete picture of community programs for youth. This is 
particularly true given the increased movement toward housing commu- 
nity programs for youth in schools and creating collaborations between 
schools and community-based organizations. 
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Population Characteristics 

The committee made the decision to focus on programs and policies 
for young people between ages 10 and 18; we refer to this target popula- 
tion throughout the report by multiple terms: young people, youth, ado- 
lescents, and teens. We recognize that among practitioners, researchers, 
and policy makers, different age brackets often define adolescence. Some 
community programs and policies for youth target children as young as 
8 years old and as old as 21; others identify a subset within this larger 
range, such as 12 to 15 or 16 to 18. The committee chose the 10 to 18 
age range because in our view it covers the most critical years of adoles- 
cent development and coincides more or less with the years of secondary 
school. However, this age range did not constrain the committee’s work 
and some deviation occurred when examining programs and policies. 
Furthermore, we recognize that the principles of adolescent development 
and the program features identified in this report have useful implica- 
tions for the programming for younger children and older adolescents 
and young adults. 

There are countless subpopulations of adolescents defined by a great 
variety of characteristics — such as youth of a particular race or ethnic 
group; youth with disabilities; gay and lesbian youth; gifted and talented 
youth; youth with special physical or emotional needs; incarcerated 
youth; runaway youth; and youth in foster care. The committee made 
the decision to look broadly at adolescents and not explicitly identify 
features of programs aimed at adolescents who fall within a particular 
subpopulation, while recognizing that some adolescents may, in fact, 
have special needs or interests and that programs may need to be adapted 
to accommodate them. 

Finally, there are various individuals and groups interested in com- 
munity programs for youth. This report was written in great part with 
an eye toward these various interests — service practitioners, policy mak- 
ers, researchers, and the young people and their families participating in 
the programs. We defined service practitioners as the staff and managers 
who provide direct services to young people. We defined policy makers 
broadly, as elected officials and bureaucrats, as well as public- and pri- 
vate-sector staff at the community and national levels, who develop, 
implement, build the capacity of, provide technical assistance to, and 
fund these programs. Members of the research community include evalu- 
ators of local, state, and national initiatives, developmental researchers, 
and professionals who consult on the theory, design, and implementa- 
tion of community programs for youth. 
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Program Approaches 

For those who design, study, fund, and work in the field of commu- 
nity programs for youth, there can be a tension in approach. Two major 
program orientations are often identified: on one side are “prevention” 
or “problem-centered” programs; on the other are “positive youth devel- 
opment” programs. Programs focused on prevention or problems are 
often stereotyped by advocates of a positive youth development perspec- 
tive as identifying teenagers as collections of specific problems in place 
or about to happen — drug use, early and inappropriate sexual activity, 
violent behavior, school failure, etc. Such programs often emphasize 
preventing problem behavior (e.g., reducing teenage drug use) and are 
often centered on a single problem, even though problems may be closely 
related (e.g., a program may concentrate on preventing teenage preg- 
nancy but give minimal attention to preventing sexually transmitted dis- 
eases). In contrast, people linked to the positive youth development ori- 
entation define themselves as being interested in young people as 
collections of assets and opportunities, rather than problems (Pittman 
and Irby, 1996; Roth and Brooks-Gunn, 2000). Programs designed from 
this orientation emphasize positive growth and development and are not 
usually designed to address specific individual problems. Broad skills 
are typically fostered and taught rather than strategies for preventing or 
managing single problematic behaviors. 

From the outset, the committee rejected this polarized view of youth 
programming. Although our charge stresses the importance of programs 
designed to promote positive adolescent development, we decided that 
both prevention and promotion approaches are needed and have great 
value. Clearly, all young people need multiple opportunities to grow in 
positive, healthy ways. They need adults who teach and encourage them, 
who help them set challenging and meaningful goals for the future, and 
who nurture an array of skills and values. But young people often also 
need specific, focused help in steering clear of specific obstacles that cur- 
rent popular culture places in their paths, such as the lure of drugs and 
alcohol and inappropriate and early sexual activity. Although an em- 
phasis on overall positive youth development can help in addressing spe- 
cific problems and challenges, more targeted, problem-centered interven- 
tions are often needed as well. 

But even more important, this distinction is often blurred when one 
examines the content and nature of individual programs. In fact, many 
programs that are broad in nature and clearly designed to promote posi- 
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tive youth development in fact devote significant time to efforts designed 
to prevent specific problems from emerging. Similarly, many programs 
that call themselves prevention programs include activities linked to com- 
munity service, mentoring, and other activities associated with positive 
development approaches. We suspect that much of the tension between 
these two perspectives derives from competition for funding and the 
changing trends in public rhetoric and policy. It is not rooted in irrecon- 
cilable differences in program design or theory. Consequently, we looked 
at both types of programs. 

The committee concluded that the quest for the perfect program is 
quixotic. We are unlikely to ever define a single all-time-winner pro- 
gram that should be replicated in cookie-cutter fashion in all American 
communities. There are several reasons for this cautionary note. First, 
the diversity of young people, their particular needs, and their surround- 
ing environments argue against the notion that a single program will fit 
all situations. Second, the funding needed to evaluate all possible mod- 
els, thereby closing in on the perfect intervention, is simply not available 
and unlikely to become so. Third and perhaps most important, there is 
a certain aspect to the challenge of working with young people that is an 
art, not a science, as any parent or teacher can tell you. Yes, we can 
describe broad aspects of programs for youth that seem especially useful, 
such as the widely recognized value of having youth themselves play an 
active role in the design and tone of individual programs, but in the end, 
success often hinges on such intangibles as the quality of the relationship 
between an individual young person and the program leader, or the in- 
terpersonal chemistry of a particular group of teenagers (McLaughlin, 
2000 ). 



Underlying Values and Perspectives 

Conducting the study that produced this report raised numerous 
questions of values, which are not scientific matters and can spark vehe- 
ment disagreement. First, although the government has a long history of 
investing in schools and supporting universal access to education, there 
is less consensus about whether it should invest in young people’s 
nonschool hours. For that reason, persuasive evidence that community 
programs for youth improve their lives cannot be expected to lead auto- 
matically to increased public investment in such programs. 

One reason cited for the increasing interest in after-school and youth 
development programs is that the growing presence of women in the 
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workforce has led to greater demands for activities that, among other 
things, provide youth with supervision during nonschool hours. Discus- 
sion of these programs often reveals widely varying views about the role 
of women (or, in this case, mothers) in the workforce and the extent to 
which their changing roles underlie community programs for young 
people. 

Any attempt to understand the role of community programs in the 
lives and development of young people necessarily incorporates some 
basic judgments about the attributes we hope that young people develop 
(see Chapter 3). The committee acknowledges up front that cataloguing 
the personal characteristics that young people need to possess invariably 
includes subjective judgment. Other groups might come up with a differ- 
ent set of desirable attributes. But we also decided that it is important 
for community programs to have explicit goals regarding what assets or 
characteristics they would like to promote. Such goals are important 
because they should be used to design and then evaluate the program 
activities. Having explicit goals makes both evaluation and accountabil- 
ity much easier. The committee expanded its charge to include a scien- 
tific assessment of what such goals might be. 

This report does not take on directly the question of the appropriate 
relationship between schools and community programs. Rather, as noted 
earlier, we concentrate on discussing what young people need for healthy 
growth and development, recognizing that, in some communities, fami- 
lies, schools, and existing community organizations may well provide 
most, if not all of the structures, conditions, and experiences necessary to 
meet the needs of young people — making additional government-funded 
community programs relatively marginal. In other areas, the need for 
community programs may be acute because existing institutions, includ- 
ing the schools, are not able to meet the needs of all adolescents. What 
this logic suggests is that communities as a whole should regularly review 
what is available for their young people and then make judgments about 
which institutions — schools, community programs, and others — can and 
should fill the gaps. Invariably, communities will answer this challenge 
differently and come to varying views about the precise responsibilities 
of home, school, and community programs. 

Finally, we do not pretend that this report offers the definitive or 
final blueprint for positive youth development. Young people are influ- 
enced by a large array of factors, ranging from their family to the compli- 
cated world of the Internet and the forces of popular culture. In truth, 
all such forces can and should be enlisted to bolster the development of 
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the next generation. But the work of this committee and its report are 
confined to one small part of the puzzle: community programs for youth. 
We have not outlined a plan to overhaul adolescence in America, but 
only to consider one small part of the enterprise. 



Core Concepts 

There is a set of core concepts around which the committee based its 
work and that serve as a foundation for this report: 

° Some youth are doing very well; 

° Some youth are taking dangerous risks and doing poorly; 

° All young people need a variety of experiences to develop to their 
full potential; and 

° Some young people have unmet needs and are particularly at risk 
of participating in problem behaviors (e.g., dropping out of 
school, participating in violent behavior). These include young 
people who often, but by no means always, live in high-risk neigh- 
borhoods, are poor, experience repeated racial and ethnic dis- 
crimination, and have a substantial amount of free, unsupervised 
time during nonschool hours. Other youth who are in special 
need of more programs include youth with disabilities of all kinds, 
youth from troubled family situations, and youth with special 
needs for places to find emotional support. 

GUIDE TO THE REPORT 

This report has four parts. Part I, which includes Chapters 2, 3, and 
4, provides a framework for promoting adolescent development. Chap- 
ter 2 is an overview of adolescent development with attention to devel- 
opmental issues for youth of different ages. Chapter 3 discusses what 
constitutes evidence of positive youth development, drawing on empiri- 
cal studies of well-being and positive developmental outcomes, as well as 
practical wisdom from leaders in this field about the core human needs 
and attributes that young people need to develop. This chapter presents 
a list of personal and social assets that predict current and future well- 
being. Chapter 4 reviews what is known about the features of the set- 
tings in adolescents’ daily life that facilitate the development of these 
assets. Evidence from both theoretical and practical field-based observa- 
tions is included. 
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Part II, which includes Chapters 5 and 6, reviews what the commit- 
tee found out about community programs themselves. Chapter 5 exam- 
ines the ways in which programs incorporate features of positive devel- 
opmental settings and provide opportunities for young people to acquire 
the personal and social assets characteristic of positive youth develop- 
ment. To do this, we map the features of positive developmental settings 
against a variety of programs that have been studied with nonexperi- 
mental evaluation methods and then draw conclusions about the pro- 
gram practices that are linked empirically to positive indicators of ado- 
lescent development. Chapter 6 reviews the evidence of effective program 
practices from experimental evaluations of community programs for 
youth. We end this chapter by mapping what we learned from experi- 
mental program evaluations onto the features of positive developmental 
settings outlined in Chapter 4. 

Part III, which includes Chapters 7 and 8, examines the role for 
evaluation and social indicator data in thinking about community pro- 
grams for youth in the future. Chapter 7 discusses the various methods 
and tools available to evaluate youth programs and generate new infor- 
mation about them. Chapter 8 explores existing social indicators and 
data instruments that help elucidate the attributes of program partici- 
pants. We also suggest other information and tools needed in order to 
better understand young people and evaluate these programs. 

Finally, Part IV examines the intersection among research, policy, 
and practice for community programs for youth. In Chapter 9 we exam- 
ine existing and anticipated policy and system-level supports and barri- 
ers. In the final chapter, Chapter 10, we summarize the committee’s 
conclusions and recommendations that span the areas of practice and 
policy and evaluation, research, and data collection. 
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Adolescence is a pivotal period for youth to acquire the attitudes, 
competencies, values, and social connections that will help carry them 
forward to successful adulthood. As described in Chapter 1, some young 
people do very well during this time; others experience gaps in their lives 
that lead to risky and harmful behaviors. Understanding how to charac- 
terize positive adolescent development was a fundamental aspect of the 
committee’s work. 

This section has three goals: Chapter 2 provides an overview of ado- 
lescent development; Chapter 3 summarizes what is known about the 
personal and social assets that are likely to be linked to both well-being 
during adolescence and the transition into adulthood; and Chapter 4 
explores what the daily settings and experiences of adolescents need to 
include in order to promote the acquisition of these assets and function 
as a positive developmental setting. In our view, a good understanding 
of these topics is important in the design and evaluation of community 
programs for youth. These programs are intended to both support posi- 
tive development and prevent involvement in problematic behaviors 
likely to mortgage a youth’s future. To accomplish these aspirations, 
program designers and evaluators need to be guided by what is known 
about development during adolescence as well as about resilience more 
generally. They also need to be guided by what is known about the kinds 
of social experiences that facilitate positive development. 

Scientists and program providers have suggested a number of core 
human needs, attributes, and both personal and social assets that can 
facilitate adolescents’ present well-being, reduce their risk-taking, and 
increase the likelihood of their successful future transitions. Develop- 
ment occurs over time, with experiences in the present being critical for 
both current well-being and future success. From research in this area, 
the committee developed a set of core concepts: 

© The acquisition of personal and social assets — in the domains of 
physical, intellectual, psychological and emotional, and social 
development — leads to positive adolescent development. 

0 Adolescents with more personal and social assets in each of these 
areas have a greater chance of both current well-being and future 
success. 

° Personal and social assets are enhanced by positive developmental 
settings. 
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What do the daily settings and experiences of adolescents need to 
include in order to promote the acquisition of these assets and function 
as a positive developmental setting? Based on theories of positive devel- 
opment and empirical research on features of settings, the committee 
developed a list of eight features of settings that promote adolescent de- 
velopment: physical and psychological safety; appropriate structure; sup- 
portive relationships; opportunities to belong; positive social norms; sup- 
port for efficacy and mattering; opportunities for skill building; and 
opportunities for integration among family, schools, and community ef- 
forts. Research shows that the more settings that adolescents experience 
reflecting these features, the more likely they are to acquire the personal 
and social assets linked to both current and future well-being. 

There are a variety of settings in which adolescents’ can experience 
the opportunities needed for positive development. Young people need 
continuous exposure to positive experiences, settings, and people, as well 
as abundant opportunities to refine their life skills so that they have the 
means to move into productive jobs and other roles that build fulfilling 
relationships. Some youth live in families and neighborhoods that en- 
sure these experiences; others live in environments in which community 
programs are necessary to ensure them. 



CHAPTER 2 



Adolescent Development 



W hat do you think of when you imagine an adolescent? Al- 
though some people picture a helpful, well-functioning 
young person, others envision a gangly, awkward, brood- 
ing, and troublesome individual. Even parents and teach- 
ers sometimes bemoan the changes that occur as their chil- 
dren move into and through adolescence. Elementary 
school-age children are seen as cute, cooperative, and ready 
to learn. In contrast, adolescents are often seen as prob- 
lems waiting to happen. Until recently, researchers shared 
this view. Historically, this period of life was labeled by 
developmental scientists as a time of storm and stress 
(Arnett, 1999). Although we now know that most young 
people pass into and through adolescence with few major 
problems, some find this a very difficult period of life 
(Arnett, 1999; Carnegie Corporation of New York, 1989; 
Eccles et al., 1993; Moffitt, 1993; Rutter and Smith, 1995). 

Many developmental scientists, policy makers, and 
practitioners working with youth believe that enhancing 
the lives of adolescents with positive opportunities and 
experiences could reduce the likelihood and magnitude of 
these problems (e.g., Carnegie Corporation of New York, 
1989; Charles Stewart Mott Foundation, 1998a; Dryfoos, 
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1 996; Eccles et al., 1993; Jessor, 1993, 1998; Larson, 1994, 2000; Lerner 
and Galambos, 1998; Lerner et al., 2000; Lipsitz, et al., 1997; Metro- 
politan Life, 1994; Pittman et al., 2000b; Roth, 1996; Quinn, 1999). In 
this chapter, we provide an overview of what is known about develop- 
ment during the years from 10 to 18 so that individuals interested in 
community programs for youth have an accurate understanding of whom 
adolescents are and what they need as they design, fund, operate, and 
evaluate programs. 

What is adolescent development really like? There is no doubt that it 
is a time of great change on many levels. Probably most dramatic are the 
biological changes associated with puberty, which include shifts in the 
shape of the body, increases in gonadol hormones, emergence of cyclical 
patterns of gonadol and related hormonal systems in females, onset of 
fertility, and changes in brain architecture and the receptivity of neurons 
to a variety of chemicals (Brooks-Gunn and Reiter, 1990; Buchanan et 
al., 1992; Gubba et al., 2000; Herbert and Martinez, 2001). These bio- 
logical transitions are linked to changes in sexual interest, as well as to 
changes in both cognitive and physical capacities and emotional well- 
being. There are also major social changes associated with both school 
transitions and shifts in the roles that adolescents are expected to assume 
as they mature. Finally, there are major psychological changes linked to 
increasing social and cognitive maturity. In fact, few developmental pe- 
riods are characterized by so many changes at so many different levels. 

Adolescence is also a time when individuals in most Western and 
postindustrialized cultures make many choices and experiment with a 
wide variety of behaviors and experiences that can influence the rest of 
their lives (Brown and Corbett, forthcoming; Mortimer and Larson, 
2002). For example, adolescents select which peer groups to join and 
how to spend their after-school hours. Adolescents make future educa- 
tional and occupational plans and then pursue them through secondary 
school course work and out-of-school vocational and volunteer activities. 
Finally, some youth experiment with risky behaviors, such as tobacco 
use, alcohol and other drug use, and unprotected nonmarital sexual inter- 
course. For some of these youth, the experimentation has few or no 
long-term consequences; for others, this experimentation seriously com- 
promises their future (Carnegie Corporation of New York, 1989; Na- 
tional Research Council, 1999c; Cairns and Cairns, 1994; Cicchetti and 
Toth, 1996; Elder and Conger, 2000; Jessor et al., 1991; Moffitt, 1993; 
Steinberg and Morris, 2001). Given the influence that these choices and 
behaviors can have over future life options, it is critical to understand 
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what influences whether young people stay on healthy, productive path- 
ways or move onto more problematic, and potentially destructive ones 
as they pass through this important life stage. 

DEVELOPMENTAL CHALLENGES, 
OPPORTUNITIES, AND RISKS 

Many theorists have proposed systematic ways to think about the 
developmental challenges, opportunities, and risks of this period of life. 
Historically, most prominent among these was Eric Erikson (1968). In- 
tegrating adolescence into his more general life-span model of develop- 
ment (see Appendix A), he suggested that the specific challenges for chil- 
dren between ages 10 and 18 are: developing a sense of mastery, identity, 
and intimacy. Others have expanded these challenges to include au- 
tonomy, sexuality, and achievement (e.g., Carnegie Corporation of New 
York, 1989; Havinghurst, 1972). In many cultural groups, these chal- 
lenges translate into the following more specific tasks: (1) changing the 
nature of the relationship between young people and their parents so 
youth can take on a more mature role in the social fabric of their com- 
munity (among white Americans this change often takes the form of 
greater independence from parents and greater decision-making power 
over one’s own current and future behavior; in other cultures, this change 
can take the form of greater responsibility for family support and in- 
creased participation in family decision making; in all cultures this change 
typically results in starting one’s own family and becoming integrated 
into the mainstream adult community); (2) exploring new personal, 
social, and sexual roles and identities; (3) transforming peer relation- 
ships into deeper friendships and intimate partnerships; and (4) partici- 
pating in a series of experiences and choices that facilitate future eco- 
nomic independence and interdependence. 

As made clear by many scientists interested in adolescence, each of 
these tasks is played out in an increasingly complex set of social settings 
and in both cultural and historical settings (e.g., Bronfenbrenner and 
Morris, 1998; Cairns and Cairns, 1994; Eccles et al., 1993; Elder, 1998; 
Elder and Conger, 2000; Elliott, et al., 1996; Erikson, 1968; Jessor and 
Jessor, 1977; Lerner and Galambos, 1998; Moffitt, 1993; Rutter and 
Smith, 1995; Steinberg and Morris, 2001). Optimal progress on each of 
these tasks depends on the psychosocial, physical, and cognitive assets of 
the individual, the social supports available to the individual, and the 
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developmental appropriateness of the each of the social settings encoun- 
tered by young people as they pass through adolescence. 

With rapid change of course comes a heightened potential for both 
positive and negative outcomes. Although most individuals pass through 
this developmental period without excessively high levels of storm and 
stress, a substantial number do experience difficulty (see Chapter 1). 
Involvement with criminal and antisocial behavior accelerates dramati- 
cally between the ages of 10 and 15, as does drug and alcohol use and 
sexual interactions (see Cicchetti and Toth, 1996; Eccles et ah, 1996a; 
Moffitt, 1993; Steinberg and Morris, 2001). The incidence of mental 
health problems and more general alienation also increases, particularly 
in modern, postindustrialized societies (Giddens, 1990; Eccles et al., 
1996a; Rutter and Smith, 1995). Finally, rates of school disengagement 
and school failure in the United States increase (see Eccles et al., 1998, 
for a review). Many of these changes begin during the earliest years of 
adolescent development — between the ages of 10 and 14. In turn, these 
early changes set in motion problems that can culminate in subsequent 
school failure, high school dropout, incarceration, and teen pregnancy — 
any one of which can have serious consequences for young people’s fu- 
ture (Jessor et al., 1991; Sampson and Laub, 1995). 

With specific regard to the developmental tasks of adolescence out- 
lined above, there are several concrete risks. First, renegotiation of the 
relationship with one’s parents can be so turbulent that a permanent rift 
and alienation between youth and their families emerges. Second, ado- 
lescents can get so caught up with a deviant peer group and its behaviors 
and values that they get involved in behaviors and circumstances that 
seriously endanger their ability to make a successful transition into main- 
stream adulthood. Third, adolescents can fail to make social connec- 
tions with the kinds of adults and social institution that can help them 
make the transition into mainstream adulthood. Fourth, educational 
opportunities can be so limited that some adolescents fail to acquire the 
intellectual and soft skills needed to move successfully into the labor 
market. Fifth, experiences with civic engagement and social institutions 
can be so minimal or so poorly designed that some adolescents fail to 
develop either the will or the skills necessary to participate fully as adult 
community members. Finally, experiences of racism, prejudice, and cul- 
tural intolerance can so alienate some adolescents that they withdraw from 
or rebel against, mainstream society and conventional social institutions. 

Community programs for youth have the potential to play a critical 
role during this developmental period. Evidence from several sources 
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supports the conclusion that participation in constructive and supportive 
programs during out-of-school hours both encourages positive develop- 
ment in many areas and reduces the likelihood of engagement in prob- 
lematic behaviors. These programs can remediate deficiencies in skills 
already evident by early adolescence, teach new intellectual and soft skills 
critical for high school success and movement into jobs that provide suf- 
ficient income to support a family, provide intellectually challenging ex- 
periences to foster continued cognitive development, support continued 
positive socioemotional development, help establish strong social con- 
nections between the kinds of individuals and social institutions that help 
youth both to be conventionally successful during their adolescence and 
to make a successful transition into adulthood, provide a place to meet 
peers with positive social values and a positive vision of their futures, 
and provide a place where adolescents can feel accepted and can explore 
both their personal and social identities without having to continually 
confront racism and cultural intolerance (e.g., Barber et ah, in press; 
Blum et al., 2000; Larson, 2000; Vandell and Posner, 1999; Eccles and 
Barber, 1999; Furstenberg et ah, 1999; Elder and Conger, 2000; see 
Chapters 4, 5, and 6 for more details). 

But such programs need to be developmentally, as well as culturally, 
appropriate to achieve these goals. As we discuss in more detail in the 
following sections, youth of different ages are likely to benefit from dif- 
ferent experiences. During the years between 10 and 14, they are expe- 
riencing the most dramatic biological changes and are most susceptible 
to peer influence. During this time they also typically experience the 
transition from elementary school to secondary school, and conflicts with 
parents peak. Finally, they are just beginning to have the cognitive ca- 
pacity to engage in formal reasoning. Programs for this age group need 
to take these characteristics into account. Developmental theory and the 
empirical evidence reviewed in Chapters 3 and 4 suggest the following 
kinds of programmatic needs for this age group: 

Educational programs that: 

— Help young adolescents and their parents understand the bio- 
logical changes they are experiencing; 

— Make sure young adolescents have the academic skills neces- 
sary to take and succeed in college preparatory secondary 
school courses; and 

— Provide sufficient intellectual challenge that young adolescents 
can learn to use formal reasoning skills effectively. 
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° Social and communication skill training programs that: 

— Help them learn to resist negative peer pressures and to com- 
municate better with their parents about such issues as sexual- 
ity, negative peer pressures, and the health risks of drug and 
alcohol use. 

° Career planning activities that: 

— Expose young adolescents to a wide range of possible careers, 
help them to develop high expectations for themselves about 
their future, and provide them with the information needed to 
begin to make appropriate educational choices that will help 
them achieve their future aspirations. 

° Practices that: 

— Respect young adolescents’ growing maturity by providing op- 
portunities for meaningful inputs into program development 
and governance. 

Evidence reviewed later in this report suggests that, as youth get 
older, the family conflicts common to the early adolescent years decrease, 
susceptibility to peer influence decreases, and both personal and social 
identity concerns increase, particularly those related to occupational, 
sexual, and ethnic identities. In addition, the biological systems stabi- 
lize, cognitive skills increase, and expertise in a variety of areas grows. 
Programs for older youth need to change in ways that reflect their grow- 
ing maturity and expertise, the new courses they are taking in high school, 
their increasing cognitive capacities, their increased concerns about iden- 
tity issues, and their movement toward the transition into adulthood. 
Again, developmental theory and empirical evidence suggest the follow- 
ing kinds of programs for older youth: 

° Educational programs that: 

— Provide tutoring for college preparatory courses; 

— Teach about multiple cultures; and 

— Help youth learn skills needed to navigate across multiple cul- 
tural settings. 

° Opportunities to: 

— Play an increasing role as mentors of younger adolescents and 
to be leaders in an organization. 
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0 Career-related experiences in a variety of occupational settings 
and career planning activities that: 

— Help them begin to focus their educational and career goals in 
ways more directly related to their emerging personal identi- 
ties. 

We say more about the issue of developmentally appropriate pro- 
gramming in Chapters 3 and 4. We now turn to a more specific discus- 
sion of developmental changes during the adolescent years. 



Biological Changes 

A complete review of the biological changes associated with puberty 
is beyond the scope of this report, but, given the centrality of these 
changes, it is important to provide a brief overview (see Adams et al., 
1989; Brooks-Gunn and Reiter, 1990; Brooks-Gunn et al., 1994; 
Buchanan et al., 1992; Caspi et al., 1993; National Research Council, 
1999a). As a result of the activation of the hormones controlling puber- 
tal development, most children undergo a growth spurt, develop primary 
and secondary sex characteristics, become fertile, and experience in- 
creased sexual libido during early adolescence. Recently researchers have 
studied exactly how the hormonal changes occurring at early adoles- 
cence (ages 9 to 13) relate to changes in behavior (e.g., see Buchanan et 
al., 1992; Petersen and Taylor, 1980). There is some evidence for direct 
effects of hormones on such behaviors as aggression, heightened sexual 
feelings, and mood swings (e.g., Albert et al., 1993; Brooks-Gunn et al., 
1994; Buchanan et al., 1992; Caspi and Moffitt, 1991; Olweus et al., 
1988; Sussman et al., 1987; Udry et al., 1986). However, these relations 
are quite complex, with hormones and other biological systems interact- 
ing in complex ways with both social behavior and genetic predisposi- 
tions to influence behaviors; the direct effects of hormones are often over- 
ridden by social experiences (e.g., see Kendler and Karkowski-Shuman, 
1997; Haggerty et al., 1994a; Robins and Robertson, 1998; Silberg et 
al., in press). To make matters even more complex, behaviors and expe- 
rience, in turn, influence the hormonal systems in quite complex ways, 
including even the timing of the onset of menarche (Goodyer, 1997; 
Graber et al., 1995). 

Because the hormonal changes are most dramatic and more irregular 
during the early adolescent period, some developmental scientists have 
suggested that young adolescents are particularly susceptible to these 
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biological influences (Carnegie Corporation of New York, 1989). The 
actual evidence for this suggestion is minimal due to paucity of relevant 
research (see Buchanan et ah, 1992). But this suggestion is consistent 
with evidence that many of the mood and behavioral changes most often 
hypothesized to be related to the hormonal changes associated with pu- 
berty are most marked during the early adolescent years (Carnegie Cor- 
poration of New York, 1989; Moffitt, 1993). 

Equally critical for this report is the issue of individual and group 
differences in both the rates and types of changes in these hormonal 
systems and individual differences in the reactions to these changes. Both 
current and previous life events and genetically linked vulnerabilities and 
propensities affect adolescents’ reactions to the hormonal changes occur- 
ring particularly during early and middle adolescence (Caspi and Moffitt, 
1991; Graber and Brooks-Gunn, in press; Gubba et ah, 2000; Rutter et 
ah, 1997; Silberg et al., in press). The nature of these interactions sug- 
gests that early adolescents living in high-risk settings may be more prone 
to the problematic effects of changes in the gonadol and adrenal hormone 
systems associated with late childhood and early adolescence. 

There are, of course, also sex differences in the nature of pubertal 
change. The hormonal changes associated with puberty are different for 
girls and boys: levels of testosterone increase more in boys, while levels 
of estrogen and progesterone increase more in girls. In addition, girls 
develop a monthly cycle of gonadol hormones; for the most part, boys 
do not. It has been suggested that the sex differences associated with the 
emergence of depression, eating disorders, and aggression may be linked 
to these differences in patterns of hormonal changes associated with pu- 
bertal development. But evidence suggests that the origins of both sex 
differences and individual differences more generally in these mood and 
behaviors patterns lie in complex interactions between experience, life 
events, intensified gender role socialization, genetically linked vulnerabili- 
ties, and changes in hormonal systems (Buchanan et al., 1992; Goodyer, 
1995; Graber and Brooks-Gunn, in press b; Keel et al., 1997; Kendler 
and Karkowski-Shuman, 1997; Kessler et al., 1993; Petersen et al., 1991; 
Rutter et al., 1997; Silberg et al., in press; Wichstrom, 1999; Zahn- 
Waxler et al., in press). Each of these authors stresses that we are just 
beginning to understand the nature of these interactions and therefore 
encourages cautious interpretation of simplistic models of the role of 
hormones in accounting for sex differences in moods or behaviors. 

There are also sex and ethnic group differences in the timing of pu- 
berty. In general, pubertal changes begin 12 to 18 months earlier for 
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girls than for boys — a fact that is likely to affect social interactions be- 
tween males and females of the same age, particularly during the early 
years of adolescence. In addition, pubertal changes begin about 15 
months earlier in black females than in white females (Herman-Giddens 
et al., 1997; National Research Council and Institute of Medicine, 
1999a). As a result, anyone working with 6th graders will immediately 
notice major differences in the physical maturity between girls and boys, 
as well as among groups of girls. Many females at this age look and act 
like fully mature young women. In contrast, most of the males still look 
and act like boys. The impact of these differences on the development of 
early adolescents is likely to vary by cultural group, depending on beliefs 
and norms about appropriate roles for physically mature individuals, 
appropriate sexual activities, and ideals related to female and male 
beauty. Such differences also have implications for the design of devel- 
opmentally appropriate experiences for early adolescent girls and boys 
of different racial or ethnic groups in community programs. Girls will 
need educational programs related to puberty and fertility change earlier 
than boys. Girls are also likely to need places in which to discuss family 
interactions and concerns about their changing bodies at a younger age 
than boys are, and black girls are likely to need these experiences at a 
younger age than white girls. 

There are also major individual differences in the timing of puberty 
within each sex and racial/ethnic group — some children begin their pu- 
bertal changes earlier than others (Stattin and Magnusson, 1990). The 
timing of pubertal development has major implications for many aspects 
of life. Once again, cultural beliefs and norms are likely to influence the 
meaning of early maturation for both girls and boys, so the implications 
of pubertal timing for youth programming will differ across groups. For 
example, among white populations, early maturation tends to be advan- 
tageous for boys, particularly with respect to their participation in sports 
activities and social standing in school. In contrast, early maturation is 
often problematic for white girls — being linked to increased rates of eat- 
ing disorders, depression, and involvement in a variety of problematic 
behaviors (Caspi and Moffitt, 1991; Flannery et al., 1993; Ge X et al., 
1996b; Graber and Brooks-Gunn, in press; Silbereisen et al., 1989; 
Simmons and Blyth, 1987; Stattin and Magnusson, 1990). Interestingly, 
these problematic correlates of early puberty are not as evident in black 
populations (Michaels and Eccles, 2001; Simmons and Blyth, 1987). We 
do not know about the strength of association for other racial/ethnic 
groups. Although we do not yet understand the origins of these ethnic 
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group differences, it has been suggested that early pubertal maturation 
may be particularly problematic for white American girls, because the 
kinds of physical changes girls experience with puberty (such as gaining 
weight) are not highly valued by many white Americans, who seem in- 
stead to value the slim, androgynous female body characteristic of white 
fashion models (see Petersen, 1998; Simmons and Blyth, 1987). In fact, 
early-maturing white females have lower self-esteem and more difficulty 
adjusting to school transitions, particularly the transition from elemen- 
tary to junior high school than later-maturing white girls, white boys in 
general, and both black girls and boys (e.g., Eccles et al., 1996b; Simmons 
and Blyth, 1987). These results suggest that youth-serving organizations 
should be especially sensitive of the need to design programs that will 
support self-esteem and prevent depression and eating disorders for early- 
developing white adolescents. 

Early maturation can also lead to increased sexual attention from 
boys and men, which can be quite difficult for adolescent girls to handle. 
Programs designed to help girls deal with these pressures would be espe- 
cially useful during the early adolescent years. The need for such pro- 
grams is made even more salient by the work of Magnusson and Stattin 
(Magnusson, 1988; Stattin and Magnusson, 1990). 

Magnusson and Stattin traced the long-term consequences of early 
maturation in a population of Swedish females. The early-maturing girls 
in this study obtained less education and married earlier than their later- 
maturing female peers. These researchers attributed this difference to 
the fact that the early-maturing females were more likely to be recruited 
into older peer groups and to begin dating older males; in turn, as these 
girls got older, they were more likely to drop out of school and get mar- 
ried, perhaps because school achievement was not valued by their peer 
social network, while early entry into the job market and early marriage 
were (Magnusson, 1988; Stattin and Magnusson, 1990). 

Although this study focused on Swedish youth, it clearly illustrates 
the fact that pubertal changes influence individual development as much 
through their impact on social roles and social interactions as through 
their direct impact on the mind and body of the individual. Because 
these girls looked more mature, they were recruited into an older peer 
group. In turn, participating in older peer groups created a particular set 
of experiences that had long-term consequences for individual develop- 
ment. 

Similar processes are now being studied in other groups. For ex- 
ample, there is growing concern about the ways in which adults change 
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their interaction style with black boys as these boys’ bodies mature. 
Teachers and adults on the street react with more fear and avoidance of 
black boys as they begin to look more like men (Spencer, 1995; Spencer 
et al., 1998). Similarly, the body changes associated with puberty may 
lead to increased pressure to join gangs in communities in which gangs 
are a major form of peer interaction. As discussed throughout this report, 
community programs have the potential to provide alternative settings 
that reduce such pressures and negative experiences. Such programs are 
particularly important during the early adolescent years, when young 
people do not have the social and emotional maturity to cope well with 
these kinds of pressures. 

Directly linked to the biological changes associated with puberty are 
the changes in both body architecture and emotions related to sexuality. 
Puberty is all about the emergence of sexuality. The physical changes of 
puberty both increase the individual’s own interest in sex and others’ 
perception of them as sexual objects. Both of these changes can have a 
profound impact on development. Sexual behavior increases dramati- 
cally during early to middle adolescence: the most recent report from the 
National Longitudinal Study of Adolescent Health (Blum et al., 2000) 
indicates that rates of sexual intercourse rise from 16 percent among 7th 
to 8th graders to 60 percent among 11th and 12th graders. 

Accompanying these age-related increases are increases in pregnancy 
and sexually transmitted diseases. The rate of age-related increases in 
sexual intercourse is particularly high among blacks and adolescents liv- 
ing in poor and single-parent households. The rate of age-related in- 
crease in sexual intercourse is also especially high among adolescents 
who are involved in an extended romantic relationship and who perceive 
the benefits of sexual relations as high and the cost of sexual relations 
(including the cost of becoming pregnant) as low. Rates are particularly 
low among adolescents who want to avoid becoming pregnant so that 
they can fulfill their educational and occupational aspirations (Blum et 
al., 2000; see also Kirby and Coyle, 1997). 

Some interventions designed to help adolescents form and maintain 
high educational and occupational aspirations and to reduce their early 
involvement in romantic relationships have been effective at lowering 
rates of unprotected sexual activity and unplanned pregnancies (Kirby 
and Coyle, 1997; Nicholson and Postrado, 1992; Weiss, 1995). Com- 
munity programs have the potential to support these aspirations as well 
as provide adolescents with constructive activities that help them resist 
peer pressure for involvement in unprotected sexual behavior. Programs 
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that help girls and boys deal with sexual feelings and support positive 
communications with parents would be especially useful for early ado- 
lescents. Programs that stress future life planning and support high edu- 
cational goals would be especially useful as the boys and girls mature 
into middle and late adolescence. 

Interesting new research on the development of the brain during 
adolescence also points to the important biological changes youth un- 
dergo. Based on a series of brain scans, neuroscientists have documented 
that the development of the brain continues beyond the early years into 
adolescence. In fact, the frontal lobes of the brain, responsible for func- 
tions such as self-control, judgment, emotional regulation, organization, 
and planning, may undergo the greatest change between puberty and 
young adulthood (Begley, 2000). This work points to the importance of 
opportunities to develop and practice these skills during the early and 
middle adolescent years. We discuss this need in more detail in the next 
section. 



Changes in Cognition 

The most important cognitive changes during this period of life re- 
late to the increasing ability of youth to think abstractly, consider the 
hypothetical as well as the real, process information in a more sophisti- 
cated and elaborate way, consider multiple dimensions of a problem at 
once, and reflect on oneself and on complicated problems (see Keating, 
1990). Indeed, such abstract and hypothetical thinking is the hallmark 
of Piaget’s formal operations stage, assumed to begin during adolescence 
(e.g., Piaget and Inhelder, 1973). Although there is still considerable 
debate about when exactly these kinds of cognitive processes emerge and 
whether their emergence reflects global stage-like changes in thinking 
skills as described by Piaget, most researchers are now convinced by evi- 
dence that these kinds of thought processes are more characteristic of 
adolescents’ than of younger children’s cognition. The emergence of 
these skills, however, is a gradual process that takes place over the entire 
adolescent period and depends on having extensive experience in learn- 
ing how to use these skills and then practicing them repeatedly and ap- 
plying them to novel and increasingly complex problems (Clark, 1988; 
Keating, 1990). Too often, however, such opportunities are not pro- 
vided in secondary schools, particularly in high-risk and poor neighbor- 
hoods (Coleman et al., 1966; Coleman and Hoffer, 1987). Out-of-school 
community programs may help fill this gap. 
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Many cognitive theorists have also assessed how more specific infor- 
mation-processing skills (topic-specific thinking and problem-solving 
skills), cognitive learning strategies (strategies consciously used by people 
to learn new information), and metacognitive skills (skills related to the 
conscious monitoring of one’s own learning and problem-solving activi- 
ties) change over development (e.g., Bjorklund, 1989; Siegler, 1986; 
Zimmerman, 1989). There is a steady increase in children’s informa- 
tion-processing skills and learning strategies, their knowledge of a vari- 
ety of different topics and subject areas, their ability to apply their knowl- 
edge to new learning situations, and their awareness of their strengths 
and weaknesses as learners. Although one would think that these types 
of cognitive changes ought to allow adolescents to be more efficient, 
sophisticated learners, ready to cope with relatively advanced topics in 
many different subject areas, Keating (1990) has argued that these 
changes do not necessarily make adolescents better thinkers, particularly 
during the early adolescent years. They need a lot of experience exercis- 
ing these skills before they can use them efficiently (see also Clark, 1988). 
Community programs may provide adolescents the opportunity to prac- 
tice these skills and take advantage of increasing competence by allowing 
them to play significant roles in program design and implementation. 
Enlisting adolescents as peer tutors for younger children, for example, is 
an excellent example of both of these opportunities. Tutoring experi- 
ences are also likely to help adolescents: (1) consolidate earlier learning 
related to the fundamental skills needed for college preparatory high 
school courses; (2) learn to analyze learning as they try to teach someone 
else new skills (which in turn can help them become better learners them- 
selves); (3) feel valued and respected by adults; and (4) improve their 
skill at taking the perspective of others. 

Along with their implications for children’s learning, these cognitive 
changes also affect individuals’ self-concept, thoughts about their future, 
and understanding of others. Theorists from Erikson (1963) to Harter 
(1990), Eccles (Eccles and Barber, 1999), Youniss (Youniss, 1980; Yates 
and Youniss, 1998), and Sullivan (1953) have suggested that the adoles- 
cent years are a time of change in self-concept, as young people consider 
what possibilities are available to them and try to come to a deeper un- 
derstanding of themselves in the social and cultural settings in which 
they live. In a culture that stresses personal choice in life planning, these 
concerns and interests set the stage for personal and social identity for- 
mation focused on life planning toward educational, occupational, recre- 
ational, and marital choices. These sorts of self-reflections require the 
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kinds of higher-order cognitive processes just discussed. Community pro- 
grams have the potential to provide the opportunity for youth to use 
these new cognitive skills to form positive, realistic views of themselves 
and then to make well-informed future plans. 

During adolescence, individuals also become much more interested 
in understanding others’ internal psychological characteristics, and 
friendships come to be based more on perceived similarity in these char- 
acteristics (see Selman, 1980). Again, these sorts of changes reflect the 
broader changes in cognition that occur at this time. Community pro- 
grams have the potential to provide a safe setting in which adolescents 
can explore themselves in relation to a wide range of activities and people. 
Such experiences are likely to help adolescents deal with issues related to 
social identity formation, as well as both tolerance and respect for cul- 
tural diversity. This should be especially true for adolescents during 
their high school years. 



Social-Contextual Changes 

Changes related to social context associated with adolescence in the 
United States need to be taken into consideration in designing commu- 
nity programs for youth. These include friendships and peer groups, 
changes in family relations, and school transitions. 



Friendships and Peer Groups 

Probably the most controversial changes during adolescence are 
those linked to peer relationships. One major change in this area is the 
general increase in peer focus and involvement in peer-related social, 
sports, and other extracurricular activities; the other major change is the 
increase in the importance of romance and sexuality in peer relation- 
ships. We discussed this second aspect of adolescent peer relationships 
earlier. Here we focus on the first aspect of change in peer relationships. 

Many adolescents attach great importance to the activities they do 
with their peers — substantially more importance than they attach to aca- 
demic activities (Wigfield et al., 1991). Indeed, often to the chagrin of 
parents and teachers, activities with peers, peer acceptance, and appear- 
ance take precedence over school activities, particularly during early ado- 
lescence. Furthermore, early adolescents’ confidence in their physical 
appearance and social acceptance is often a more important predictor of 
self-esteem than confidence in their cognitive or academic competence 
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(Harter, 1990; Lord et al., 1994). The strength of these relationships 
declines as adolescents get older and more confident of their abilities, 
their social standing, and their own goals and values. 

In part because of the importance of social acceptance during ado- 
lescence, friendship networks during this period often are organized into 
relatively rigid cliques that differ in social status within school and com- 
munity settings (see Brown, 1990). The existence of these cliques prob- 
ably reflects adolescents’ need to establish a sense of identity; belonging 
to a group is one way to answer the question: Who am I? Several theo- 
rists have argued that the peer group is a powerful place for identity 
formation and consolidation (Eccles and Barber, 1999; Mead, 1935; 
Sullivan, 1953; Youniss, 1980; Youniss et al., 1997). Vygotsky (1978) 
argued that peer interactions are also particularly important for the kinds 
of advances in cognitive reasoning associated with adolescence precisely 
because these interactions are more egalitarian than adult-child inter- 
actions. 

Also, in part because of the importance of social acceptance, 
children’s conformity to their peers and susceptibility to negative peer 
influence peaks during early adolescence (Brown, 1990; Ruben et al., 
1998). Much has been written about how this peer conformity can create 
problems for adolescents, and about how “good” children often are cor- 
rupted by the negative influences of peers, particularly by adolescent 
gangs (Harris, 1995; Steinberg, 1997; Steinberg and Morris, 2001). In 
fact, many of the prevention programs discussed in Chapter 6 were spe- 
cifically designed to counter negative peer influences. However, al- 
though pressure from peers to engage in misconduct does increase during 
adolescence (see Brown, 1990; Ruben et al., 1998), most researchers do 
not accept the simplistic view that peer groups are primarily a bad influ- 
ence during adolescence. More often than not, adolescents agree more 
with their parents’ views than their peer groups’ views on major issues, 
such as morality, the importance of education, politics, and religion 
(Ruben et al., 1998; Smetana, 1995; Smetana et al., 1991). Peers have 
more influence on such things as dress and clothing styles, music, and 
activity choice. In addition, adolescents tend to hang around with peers 
who hold similar views as their parents on the major issues listed above. 
Finally, adolescents usually seek out similar peers; this means that those 
involved in sports will have other athletes as friends; those serious about 
school will seek those kinds of friends. 

These changes in the nature of peer relationships provide an excel- 
lent rationale for the availability of high-quality community programs. 
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By their very nature, these programs create and support peer groups. By 
providing a setting in which youth in peer groups can be actively and 
regularly involved in social, productive activities, these programs likely 
can increase the positive and decrease the negative influence that peers 
can have in each other’s development. Such experiences are likely to be 
especially important during the early and middle adolescent years, when 
there are such dramatic increases in involvement in delinquent and anti- 
social behaviors (Moffitt, 1993) and when susceptibility to negative peer 
influences is at its peak. Later in adolescence, community programs can 
provide opportunities for middle and late adolescents to both work with 
and supervise younger adolescents and be mentored by older adolescents 
and young adults. Such experiences both provide the older adolescents 
with a feeling of being respected and making an important contribution 
to the organization, as well as the opportunity to see concrete examples 
of successful transitions into adulthood. 

Youth-serving organizations do have to be careful about one thing: 
programs that enroll or attract a disproportionately large number of 
adolescents who have antisocial values and are already involved in crimi- 
nal, aggressive, and otherwise problematic behaviors. Work by Tom 
Dishion and his colleagues have shown that one can get increases in 
problem behavior when programs specifically target youth already in- 
volved in problematic behaviors (Dishion and Andrews, 1995; Dishion 
et al., 1999a). This is particularly likely if such youth are the majority of 
program participants. 



Changes in Family Relations 

Although the extent of actual disruption in parent-adolescent rela- 
tions is not as great as one might expect given stereotypes about this 
period of life, there is little question that parent-child relations do change 
during adolescence (e.g., Buchanan et al., 1992; Collins, 1990; Paikoff 
and Brooks-Gunn, 1991; Petersen, 1988). As adolescents mature, they 
often seek more independence and autonomy and may begin to question 
family rules and roles, leading to conflicts particularly around issues like 
dress and appearance, chores, and dating, particularly during the early 
adolescent years (see Collins, 1990; Smetana, 1995; Smetana et al., 
1991). However, despite these conflicts over day-to-day issues, parents 
and adolescents agree more than they disagree regarding core values 
linked to education, politics, and spirituality. 
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With the onset of adolescence, parents and their children in some 
cultural groups show a decrease in the time they spend interacting with 
each other and in the number of activities they do together outside the 
home. These declines are quite common in white middle-class families in 
America (Larson and Richards, 1991; Steinberg, 1990). We know much 
less about how typical these declines are in other cultural groups. 
Steinberg (1990) argues that this “distancing” in relations between ado- 
lescents and parents is a natural part of adolescent development, citing 
evidence from nonhuman primates that puberty is the time at which par- 
ents and offspring often go their separate ways. Because parents and 
adolescents in American culture usually continue to live together for a 
long time after puberty, distancing rather than complete separation may 
be the evolutionary vestige in humans. Although he did not take an 
evolutionary perspective, Collins (1990) also concluded that the distanc- 
ing in parent-adolescent relations has great functional value for adoles- 
cents, in that it fosters their individualization from their parents, allows 
them to try more things on their own, and develops their own compe- 
tence and efficacy. It should be noted, however, that this distancing is 
not universal. It occurs less frequently and less extremely in many non- 
Western cultures and in both Hispanic and Asian communities in the 
United States (Larson and Verma, 1999; Mortimer and Larson, 2002). 

These changes in family relationships have two important implica- 
tions for community programs for youth. First, community programs, 
particularly for early adolescents, can help support good communica- 
tions and relationships between youth and their parents. Programs such 
as those developed by Girls, Inc. (2000a) for preventing adolescent preg- 
nancy have specifically focused on facilitating parent-youth communica- 
tion about issues of sexuality and resisting peer pressure. Community 
programs can provide a setting outside the family in which adolescents 
can explore their growing independence and autonomy from their par- 
ents in well-supervised, safe, and constructive environments. These pro- 
grams have the potential to provide the opportunity for youth to form 
close supportive relationships with both familial and nonfamilial adults. 
These relationships in turn can provide a way for youth to discuss and 
explore issues of identity and morality as well as future life options. 
These relationships also have the potential to provide them with impor- 
tant social connections that can help them as they navigate adolescence 
and the transition into adulthood. 



62 



Community Programs to Promote Youth Development 



School Transitions 

In most American communities, youth experience at least one major 
school transition — the transition into high school — and often two major 
school transitions — an additional transition into either middle or junior 
high school — during the years from 10 to 18. Several scholars and policy 
makers have suggested a link between these school transitions and the 
declines in academic success experienced by many early adolescents. For 
example, Simmons and Blyth (1987) compared the developmental out- 
comes for youth in two different school configurations: a traditional K-6, 
7-9, 10-12 grade configuration versus a K-8, 9-12 school configuration. 
They found a greater decline in school grades for those adolescents who 
moved from an elementary school into a junior high school at the end of 
6th grade than for those who remained in a K-8 school. Furthermore, 
because this decline in grades was predictive of subsequent school failure 
and dropping out, the youth who experienced the junior high school 
transition were at greater risk of subsequent school failure and dropping 
out than those who remained in the K-8 schools. Roderick (1993) pro- 
vided similar evidence of an association between the drop in grades over 
the junior high school transition and high school dropout. Simmons and 
Blyth (1987) also documented a greater decline in females’ self-esteem 
and a greater increase in males’ sense of being victimized for young people 
who experienced the junior high school transition than for those in the 
K-8, 9-12 grade configuration. Both Eccles and her colleagues (Eccles et 
al., 1993) and the Carnegie task force on middle grades education con- 
cluded that the junior high school transition also contributes to declines 
in interest in school, intrinsic motivation, self-concepts and self-perceptions, 
and confidence in one’s intellectual abilities, especially following failure 
(see Carnegie, 1995; Eccles et al., 1993, for evidence that these declines 
are especially marked for youth living in poor communities and for youth 
who are already having academic or other difficulties before the school 
transition). 

Drawing on person-environment fit theory, Eccles and Midgley 
(1989) proposed that the negative motivational and behavioral changes 
associated with these school transitions result from the fact that many 
junior and senior high schools do not provide appropriate educational 
environments for youth in early and middle adolescence. According to 
this theory, behavior, motivation, and mental health are influenced by 
the fit between the characteristics that individuals bring to their social 
environments and the characteristics of the environments themselves. 
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Individuals are not likely to do very well or be very motivated if they are 
in social environments that do not fit their psychological needs. If the 
social environments in the typical junior high schools and middle schools 
do not fit very well with the psychological needs of adolescents, this 
theory predicts a decline in their motivation, interest, performance, and 
behavior. 

Evidence from a variety of sources supports this hypothesis (see 
Eccles et al., 1998). Both of these early adolescent school transitions 
often involve the following types of contextual changes: (a) a shift from 
a smaller to a larger school; (b) a shift from a less to a more bureaucratic, 
more controlling, and more heterogeneous social system; (c) a shift to a 
social setting with less personal contact with adults and less opportunity 
to be engaged in school activities and responsible school roles; (d) a shift 
to a more rigid, socially comparative grading system; and (e) a shift to a 
more rigid curriculum tracking system focused on different life trajecto- 
ries (e.g., the vocational educational track versus the college-bound edu- 
cational track). Along with these changes, evidence from classroom- 
based studies suggest that teachers in junior high schools and large middle 
schools feel less able to teach all of their students the more challenging 
academic material and are more likely to use exclusionary and harsh 
discipline strategies that can effectively drive low-achieving and prob- 
lematic students away from school (see Eccles and Midgley, 1989; Fine, 
1991). 

Research in a variety of areas has documented the impact on motiva- 
tion and school engagement of such changes in classroom and school 
environments. For example, the big school/small school literature has 
demonstrated the motivational advantages of small secondary schools, 
especially for marginal students (Barker and Gump, 1964; Elder and 
Conger, 2000). Similarly, the teacher efficacy literature has documented 
the positive consequences of high teacher efficacy on student motivation 
(Ashton, 1985; Brookover et al., 1979). The list of such influences could 
go on. The point is that the motivational problems seen at early adoles- 
cence may be a consequence of the type of school environment changes 
these students are forced to adapt to rather than the characteristics of the 
developmental period per se. 

Eccles and her colleagues stress the fact that these school changes are 
particularly problematic for early adolescents — in fact they label this 
phenomenon stage-environment misfit. Evidence suggests that early ado- 
lescent development is characterized by increases in the desire for au- 
tonomy, peer orientation, self-focus and self-consciousness, salience of 
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identity issues, concern over heterosexual relationships, and capacity for 
abstract cognitive activity (see Brown, 1990; Eccles et al., 1998; Harter, 
1990; Keating, 1990; Simmons and Blyth, 1987). Simmons and Blyth 
(1987) argue that young adolescents need safe, intellectually challenging 
environments to adapt to these shifts. In light of these needs, the envi- 
ronmental changes associated with the transition to junior high school 
seem especially harmful, in that they emphasize competition, social com- 
parison, and ability self-assessment at a time of heightened self-focus; 
they decrease decision making and choice at a time when the desire for 
control is growing; they emphasize lower-level cognitive strategies at a 
time when the ability to use higher-level strategies is increasing; and they 
disrupt social networks at a time when adolescents are especially con- 
cerned with peer relationships and may be in special need of close adult 
relationships outside the home. Consequently, the nature of these envi- 
ronmental changes, coupled with the normal course of individual devel- 
opment, is likely to result in a poor fit between early adolescents and 
their classroom environment, increasing the risk of negative motivational 
outcomes, especially for low-achieving adolescents. 

Youth-serving organizations can use this information to design more 
developmentally appropriate activities and settings for early adolescents. 
By so doing they may be able to counteract the experiences in many 
schools that undermine early adolescents’ academic motivation and 
school engagement, through activities such as tutoring younger children 
and having a real voice in program decision making. 

SUMMARY 

In this chapter, we have provided a general overview of adolescent 
development and summarized the major changes associated with adoles- 
cent development. We stressed the fact that adolescence itself is not a 
static stage of life. Early adolescents (between ages 10 and 14) are much 
different from older adolescents (between ages 15 and 18). In many 
ways, early adolescence is likely to be the most stressful. It is during this 
period that youth are dealing with the most dramatic changes on all 
levels — from the biological changes associated with puberty to the social 
changes linked to the onset of roles and norms linked to adolescent cul- 
ture. Many also have to deal with major transitions at school. During 
this period we see the most dramatic increases in problematic behaviors 
and decreases in school engagement, the most evidence of family con- 
flict, and the most evidence of negative peer influences. By middle ado- 
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lescence, some of this turmoil has settled down, but the long-term conse- 
quences of some of these changes begin to emerge — consequences such 
as inadequate academic skills needed to take college preparatory courses, 
teen parenthood, dependence on drugs and alcohol, and alienation from 
conventional social institutions. By middle adolescence, there are also 
growing needs for help with more intellectually challenging courses and 
support in dealing with identity issues, cultural heterogeneity, career 
planning, and romantic relationships. By late adolescence, occupational 
and postsecondary educational issues are particularly salient. 

It is critical that community programs for youth take these develop- 
mental changes and needs into account. First and foremost, program 
designers need to make sure programs are developmentally appropriate 
by providing the opportunity for increasing autonomy, participation in 
program decision making, leadership, and exposure to intellectually chal- 
lenging material as participating youth mature. Second, program design- 
ers need to design the specific content of their programs to the changing 
developmental needs of the young people attending their programs. 
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CHAPTER 3 



Personal and Social Assets That 
Promote Well-Being 



1 |f aving laid out the major developmental changes and chal- 
| | lenges associated with adolescence, we now turn to a dis- 

j cussion of the personal and social assets likely to facilitate 
both successful passage through this period of life and op- 
timal transition into the next phase of life — adulthood. 1 
What assets during adolescence facilitate both current well- 
being and successful future transitions? The answer to this 
question is fundamental to both the design and the evalua- 
tion of community programs for youth. Without such a 
blueprint, funders will be unable to decide which programs 
to support, program developers will be hard pressed to de- 
sign programs since they will not know what they should 



1 We use the terms successful , optimal , positive , and healthy with great 
caution. We debated the meaning of these terms several times. These 
debates made it clear that different disciplines and different groups of 
individuals attach different connotative meaning to each of these terms. 
We have chosen to use all of them interchangeably to describe the condi- 
tion of positive development. We are using these terms to convey the idea 
of appropriately positive development that reflects the individual’s capa- 
bilities, limitations, and cultural milieu. We do not mean better than 
most other individuals or much better than normal or average levels of 
development. Instead vve mean development that is headed along a posi- 
tive trajectory toward finding a meaningful and productive place in one’s 
cultural milieu. 
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be trying to facilitate, and evaluators will have little basis for deciding 
what outcomes to measure. 2 



Many scientists and practitioners have offered suggestions. Most 
importantly, there is wide consensus that being problem-free is not suffi- 
cient. “Adolescents who are merely problem-free are not fully prepared 
for their future” (Pittman, 1991). As noted in Chapter 1 (and described 
in Chapter 6), this view goes well beyond a prevention focus. It empha- 
sizes that programs aimed primarily at reducing the odds of adolescents 
becoming involved in problem behaviors are not sufficient. Interestingly, 
as noted in Chapter 1 many successful “prevention” programs do more 
than just prevent problem behavior. They also provide experiences aimed 
at preparing youth for the future. But deciding what constitutes either 
fully prepared or positive youth development more generally is quite 
complex. Although many characteristics have been suggested, determin- 
ing the value of each is not a simple matter. It involves value judgments 
regarding what is good as well as comprehensive longitudinal research 
on the links between youth characteristics and adult outcomes. In this 
chapter, we provide an overview of the many positive assets suggested by 
both scientists and practitioners and then summarize the empirical foun- 
dation supporting these suggestions. 

We begin with a brief discussion of the issue of universality versus 
cultural specificity. Is it possible to come up with a set of indicators that 
is universal? Or is cultural specificity the norm? The committee debated 
this issue extensively. There is no question that cultural groups vary in 
the characteristics they value most for both their youth and adults. A 
very good example of this is the contrast between groups who value 
individuality, autonomy, and self-focused achievement and groups who 
value cooperation and group-focused achievement efforts (Garcia Coll 
and Magnuson, 2000; Shweder et al., 1998). Specific indicators of well- 
being are likely to be somewhat different in these two groups. However, 
it is also likely that there are some universal human needs that manifest 
themselves in specific characteristics or assets as indicators of the indi- 
viduals’ well-being. Even so, it is likely that the exact manifestations 



2 We use the term “outcomes” cautiously since most of the indicators we discuss are not 
final outcomes per se but rather indicators of progress along a successful life path. 
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vary depending on the cultural context. For example, both theory and 
empirical research suggest that a sense of competence is key to positive 
human development. However, the exact domains in which one 
“should” feel competent are likely to be quite culturally specific; that is, 
a positive sense of competence will depend on competence in those areas 
valued by the cultural group of which one is a member (Ogbu, 1994; 
Shweder et al., 1998). 

The committee concluded that this debate could be reconciled to 
some extent by carefully considering the level of analysis. On one hand, 
we agreed that there are some universal at the most abstract level of 
consideration — universal such as the need to feel competent, to be so- 
cially connected, to feel valued and respected, to actually be making a 
difference in one’s social group, to feel that one has some control over 
one’s own behaviors and experiences, and to have one’s physical and 
emotional needs met. We also agreed that the failure to have these needs 
met has a negative effect on development (see evidence later in this and 
the next chapter). On the other hand, we agreed that there would be 
extensive cultural specificity when one moves to a more specific level of 
analysis. What this means is that one must take the local cultural con- 
text into account as programs are designed and evaluated. 

The committee also spent a great deal of time discussing how to 
select a list of indicators of well-being, particularly given the cultural 
issues just outlined. We decided to rely on three sources: theory, practi- 
cal wisdom, and empirical research. Within the theory category, we 
drew on developmental theories from psychology, anthropology, and 
sociology. Within the category of empirical research, we reviewed three 
types of evidence: (1) evidence that particular characteristics are either 
positively related concurrently to other indicators of well-being or nega- 
tively related concurrently to indicators of problematic development; 
(2) evidence that particular characteristics predict positive indicators of 
adult well-being and of a “successful” 3 transition to normative adult sta- 
tuses; and (3) evidence that the experimental manipulation or training of 
particular characteristics produces changes on other indicators of either 



3 Again we use the term “successful” cautiously, since what is a successful transition to 
adulthood is likely to be culturally specific and hotly contested across groups. There is 
clearly no single way to be a successful adult, and the range of normative variations has 
increased dramatically in the United States in the past 25 years (Arnett, 2000b). 
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current well-being and adequate functioning or a successful transition 
into adulthood. Finally, we included practical wisdom as a source, be- 
cause practitioners in both the prevention and youth development com- 
munities have done considerable work over the past 20 to 30 years that 
merits inclusion. In addition, cultures have developed theories of well- 
being over centuries of experience. We agreed that these sources of wis- 
dom should not be overlooked. 

We found substantial convergence across these three sources of in- 
formation. However, it is important to note that such convergence does 
not necessarily mean that we have found “the truth.” Only true experi- 
ments (the third type of empirical study) provide unequivocal evidence of 
a causal relation between the characteristic being studied and other indi- 
cators. There are few such studies and they are often very difficult to 
conduct, given the nature of the characteristics being studied. In addi- 
tion, in order to run carefully controlled experimental studies, scientists 
often have to simplify the proposed relations between hypothesized 
causes and effects. Some developmental scientists have questioned the 
impact of such simplifications on the generalizability and ecological va- 
lidity of the findings (see Cook and Campbell, 1979; Damon and Lerner, 
1998). Consequently, they have turned to longitudinal studies as one 
way to study these associations over time in the complexity of the real 
world. However, although longitudinal studies provide information 
about hypothesized causal relations, obtained relations may reflect the 
impact of variables not measured in the study (for example, see Damon 
and Lerner, 1998; Robins and Robertson, 1998; Rutter, 2000, for dis- 
cussions of this issue). Cook and his colleagues (see Cook and Campbell, 
1979; Damon and Lerner, 1998), as well as others, have provided a va- 
riety of alternative methods for investigating causal inferences; more stud- 
ies using these methods are badly needed. 

In the meantime, the convergence of theory, practical wisdom, and 
empirical research does provide us with strong hints regarding likely 
important personal and social assets. It should be noted that manipulat- 
ing program and participant characteristics is exactly what we are asking 
the community programs to do. Careful evaluation of these programs 
will not only tell us about the program’s effectiveness, but it will also 
provide experimentally based evidence for the hypothesized causal rela- 
tions underlying the program’s design. Developmental scientists need to 
pay more attention to these programs as laboratories for studying funda- 
mental questions about human development. 
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THEORETICAL PERSPECTIVES 

Developmental theoreticians have speculated on the core human 
needs and how their fulfillment relates to well-being. Perhaps the most 
fully elaborated developmental model of this link was proposed by Eric 
Erikson (see Appendix A). We provided details on his theoretical frame- 
work in Chapter 2. For our current purposes, what is most important 
about Erikson’s framework is the specific assets he outlined as critical to 
healthy development: trust (which he linked to a positive emotional rela- 
tionships with caring adults), a strong sense of self-sufficiency, the ability 
to exercise initiative, a strong sense of industry (confidence in one’s abil- 
ity to master the demands of one’s world), a well-formed sense of per- 
sonal identity, and the ability to experience and express true intimacy. 
Interestingly, quite similar assets have been proposed by many other de- 
velopmental theorists (e.g., Bowlby, 1969,1973; Harter, 1998; Bandura, 
1994; Deci and Ryan, 1985; Connell and Wellborn, 1991; Lerner and 
Galambos, 1998; Lerner et al., 2000; Rutter and Garmezy, 1983). Their 
lists include: confidence in one’s ability to influence the world and achieve 
one’s goals (a sense of personal efficacy), a strong internal desire to 
engage in important activities (intrinsic motivation), a desire to master 
the learning tasks one is confronted with in life (mastery motivation), a 
strong desire to be socially connected, the ability to control and regulate 
one’s emotions (good emotional coping skills), a sense of optimism, and 
an attachment to at least one or two conventional prosocial institutions, 
such as schools, faith-based institutions, families, and community orga- 
nizations. 

Recently, Murnane and Levy (1996) stressed the importance a set of 
skills like the ones just listed, for successful entry into the adult labor 
market. Together these theorists suggest the following characteristics as 
core assets for both current and future well-being: 

• A sense of safety and having one’s basic physical needs met; 

© A sense of social security and attachment — confidence that one’s 
emotional needs will be met (social connectedness); 

° A sense of competence and mastery (a sense of personal efficacy 
and mastery motivation); 

0 A desire to learn and curiosity about one’s world (intrinsic moti- 
vation); 

© A sense of identity and meaning in one’s life (personal and social 
identities); 
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° Positive self-regard and general mental health; and 

° A positive sense of attachment to social institutions. 

PRACTICAL WISDOM 

Over the past 20 or so years, many lists of assets have been proposed 
by foundations, youth-serving organizations, and practitioners — for ex- 
ample, Connell et ah, (2000); the Center for Youth Development and 
Policy Research (1999); the Search Institute (Scales and Leffert, 1999); 
Carnegie Corporation of New York (1989); Dryfoos (1990); Lerner et 
al. (2000); Lipsitz et al. (1997); Pittman et al. (2000b); and Roth and 
Brooks-Gunn (2000). The Search Institute has provided the most exten- 
sive list of personal and social assets, along with a comprehensive review 
of supporting empirical research (Scales and Leffert, 1999). Their set 
falls into six general areas: commitment to learning, positive values; so- 
cial competencies (including planning skills and both interpersonal and 
cultural competence); positive personal identity; commitment to positive 
use of time; and a sense of autonomy and “mattering.” Others have 
added good physical health, cultural knowledge and skills, the ability to 
navigate across multiple cultural contexts and groups, creativity, the skills 
needed to get and keep a job, and strong institutional attachments. Fi- 
nally, in one of the most parsimonious lists, Connell, Gambone, and 
Smith (2000) proposed three critical assets: the ability to be productive, 
the ability to connect, and the ability to navigate. 

In a recent consensus meeting (see Roth and Brooks-Gunn, 2000), 
youth development advocates and youth development researchers met 
and agreed on the following set: 



° Caring and compassion; 

° Character; 

° Competence in academic, social, and vocational arenas; 

° Confidence; and 
° Connection. 

Consistent with our general notion that one can have both universals 
and culturally specific assets, each of these five assets can be broken 
down into subcomponents that reflect cultural specificity. These five are 
very consistent with the set of assets growing out of developmental 
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theory. As we show in the next section, there is also growing evidence to 
support the importance of each of these five general characteristics. 

EMPIRICAL RESEARCH 

There has been substantial research over the past 50 years aimed at 
identifying the key characteristics associated with success in American 
society. Much of this work has grown out of an effort to understand 
resilience and well-being. By and large, these suggestions coincide quite 
closely with the suggestions made by both practitioners and theorists. 

For example, in a classic longitudinal study of development of poor 
children and their families on Kauai, Hawaii, Emmy Werner and her 
colleagues (1982, 1992) concluded that the following characteristics are 
key for resilience: good cognitive skills; good social skills and an engag- 
ing personality; self-confidence, self-esteem, and a sense of personal effi- 
cacy; good self-regulation skills; good coping and adaptation skills; good 
health; strong social connections to family; strong social connections to 
prosocial organizations and networks, such as schools, faith-based insti- 
tutions, community organizations, and service-related clubs and organi- 
zations; and spirituality or a sense of meaningfulness. Clausen (1993) 
and Elder (1974) reached similar conclusions based on their classic lon- 
gitudinal work done on the Berkeley and Oakland Growth Studies. 
Clausen (1993) added “planfulness” (i.e., planning for the future and 
future life events) to the list. 

In each of these studies (as well as many others), the presence of 
these assets predicted better current and subsequent well-being. Further- 
more, in each of these studies, having more assets predicted better out- 
comes than having fewer assets. The benefits of these assets, on the 
average, appear to accumulate both over time and over the number of 
assets one has. 4 Recent reviews of both the prevention and resiliency 
literatures suggest quite a similar list of characteristics as protective fac- 
tors against getting involved in a variety of problematic behaviors (e.g., 
Catalano et al., 2000). 



4 This does not mean that an individual cannot do quite well with a limited number of 
assets. Many people lead quite successful and productive lives with only a limited number 
of assets. Some of our greatest “geniuses” have excelled despite physical and social dis- 
abilities. What these data do mean is that well-being on the average 'is easier to achieve 
when one has more rather than fewer assets. 



Personal and Social Assets That Promote Well-Being 



73 



PERSONAL AND SOCIAL ASSETS 

Based upon the committee’s review of theory, practical wisdom, and 
empirical research, as well as related studies of resilience and adolescent 
development, we have organized our list of key assets around four gen- 
eral categories: physical health, cognitive development, psychological and 
emotional development, and social development. The key indicators 
associated with each of these categories are listed in Box 3-1. The sub- 
components of our list closely match the characteristics already discussed. 
Our final list differs only in the addition of good physical and mental 
health and in the elaboration of the general categories. 

The existing literature suggests three major conclusions: (1) it is ben- 
eficial to have assets in each of the four general categories; (2) within 
each general category, one can do quite well with only a subset of the 
many characteristics listed; and (3) in general, having more assets is pre- 
dictive of better current and future well-being than having only a few. 
However, as noted earlier, these inferences are based largely on correla- 
tional designs (both time-limited and longitudinal). More experimental 
studies are needed to confirm these hypotheses. 

Physical Health 

Despite the importance of physical health for youth well-being and 
development, much of the empirical research focuses on poor health 
outcomes, such as obesity, chronic illnesses (e.g., asthma), and acute con- 
ditions (e.g., sexually transmitted diseases) rather than indicators of good 
health. This emphasis on physical health risks rather than positive health 
status is driven in part by evidence linking specific behaviors in child- 
hood and adolescence to the development of chronic diseases in adult- 
hood. There is, however, a growing body of research suggesting that 
some behaviors have direct health benefits for adolescents in addition to 
reducing risks of illness and death in the adult years. Two behaviors — 
physical activity and healthy eating — have strong support for their ben- 
eficial health effects for young people. 

Regular physical activity has been shown to improve the aerobic 
endurance and muscle strength of children and youth (Dotson and Ross, 
1985; Treuth et ah, 1998; Baranowski et al., 1992). It has been associ- 
ated with decreases in blood pressure (Strazzullo et al., 1988), higher 
HDL cholesterol levels, lower triglycerides (Armstrong and Simon- 
Morton, 1994), and favorable glucose and insulin levels (Voors et al., 
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BOX 3-1 

Personal and Social Assets That Facilitate Positive 
Tooth Development . 

[Physical development 

0 Good health habits 

• Good health risk management skills 

Intellectual development 

• Knowledge of essential life skills 

• Knowledge of essential vocational skills 

• School success 

• Rational habits of mind — critical thinking and reasoning skills 

• In-depth knowledge of more than one culture 

• Good decision-making skills 

0 Knowledge of skills needed to navigate through multiple cultural 
contexts 

Psychological and emotional development 

• Good mental health including positive self-regard 

• Good emotional self-regulation skills,. 

• Good coping skills 



1982), particularly among young people at risk for cardiovascular dis- 
ease. In addition, there is some evidence that regular physical activity 
bolsters self-esteem and self-confidence, important determinants of psy- 
chological and social functioning (Jaffee and Manzer,1992; Brown and 
Harrison, 1986). 

In the United States, overnourishment, not undernourishment, is a 
major health issue, and much of the research on diet has focused on 
obesity. Once viewed as a primary risk factor for adult cardiovascular 
disease, cancer, and diabetes, there is some recent evidence to suggest 
that excess weight carries with it more immediate health consequences 
for young people. In particular, recent increases in the prevalence of 
Type 2 diabetes, generally an adult disorder, has been associated with 
rising obesity rates for children and youth (Libman and Arslanian, 1999; 
Falkner and Michel, 1999; Rosenbloom et al., 1999). On the deficit 
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Good conflict resolution skills 

Mastery motivation and positive achievement motivation 
Confidence in one’s personal efficacy 
“Planfulness”-^planning for the future and future life events 
Sense of personal autonomy/responsibility for selfc / ; . . 
Optimism coupled with realism 
Coherent and positive personal and social identity 
Prosocial and culturally sensitive values 




• Spirituality or a sense of a “larger” purpose in life 

• Strong moral character 

° A commitment to good use of time 

Social development 

• Connectedness — perceived good relationships and trust with parents, 
peers, and some other adults 

• Sense of social place/integration — being connected and valued by 

larger social networks ' 

• Attachment to prosocial/conventional institutions, such as school, 
church, nonschool youth programs 

0 Ability to navigate in multiple cultural contexts 

• Commitment to civic engagement 



side, failure to consume adequate amounts of essential nutrients has been 
linked with poor school performance (Meyers et al., 1991) and general 
deficits in cognitive functioning (Kretchner et al., 1996). 

Not all youth are equally affected. Minority and poor adolescents 
are disproportionately represented among the obese (Troiano et al., 1995; 
Winkleby, 1994) and dietary-related deficits in cognitive functioning have 
been found among poor schoolchildren (Meyers et al., 1991). Families 
who live in poor communities are constrained by both the cost and ready 
availability of healthful foods required for a balanced diet. 

Most interventions to promote healthy diets and physical activity for 
youth have been conducted in schools (Resnicow et al., 1996). There is 
less empirical work that assesses the effectiveness of community pro- 
grams to improve their diet and physical activity (Pate et al., 2000). The 
Active Winners, an after-school and summer physical activity program 
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targeting black 5th grade students in rural South Carolina (Pate et al., 
1997) and the Minnesota Heart Health Program, one site of three in a 
large-scale cardiovascular risk reduction study (Keldner et al., 1993) are 
two community-based studies demonstrating promising trends in dietary 
choices (Keldner et al., 1993) and physical activity (Keldner et al., 1993; 
Pate et al., 1997) but no significant changes in behaviors at this point in 
the study. New programs focused jointly on diet and exercise have been 
developed by such organizations as Boys and Girls Clubs of America 
(e.g., their Body Works program) and Girls, Inc. (e.g., their Peer Coaches, 
Steppingstones, and Bridges programs) and are currently moving beyond 
successful pilot tests to more comprehensive evaluations. Given the pau- 
city of community-based studies, it is premature to discount the potential 
effectiveness of programs to promote healthy eating and physical activity 
delivered in such community settings as recreation centers, churches, and 
schools. There is a need to better understand how community health 
promotion programs work with school-based and family interventions 
to foster optimal physical health. 



Intellectual Development 

There is quite strong support for the importance of life skills, aca- 
demic success in school, “planfulness,” and good decision-making skills 
for positive development. Academic success is, without a doubt, one of 
the most powerful predictors of both present and future well-being, in- 
cluding mental health, school completion and ultimate educational at- 
tainment, ultimate occupational attainment, prosocial values and behav- 
iors, good relations with parents and prosocial friends, high levels of 
volunteerism, and low levels of involvement in such problematic behav- 
iors as risky sexual behavior, drug and alcohol abuse, and involvement 
in criminal activities (e.g., Alexander et al., 1993, 1994; Clausen, 1993; 
Elder, 1998; Elder and Conger, 2000; Entwisle and Alexander, 1993; 
Entwisle et al., 1987; Jessor et al., 1991; Scales and Leffert, 1999; 
Schweinhart et al., 1993; Werner and Smith, 1982, 1992). 

Interestingly, the link of academic success in school to mental health 
and self-esteem is much weaker for blacks and for females (Eccles et al., 
1999). As a group of individuals (such as blacks or females) learns that 
they are not expected to do well in school (or in math and physical science 
for females) and in fact do not do as well as other groups, they often, 
according to Claude Steele (Steele, 1992; Steele and Aronson, 1995), 
come to place less importance on doing well in school (or math and 
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physical science for females). By less “importance,” Steele means the 
importance of the domain for the individual’s self-esteem and self-evalu- 
ation; specifically, he predicted that both success and failure in devalued 
domains would come to mean less to the person’s sense of self than suc- 
cess or failure in more valued domains of life. By lowering the value 
attached to doing well in school (or in particular subjects like math and 
science), individuals in particular groups can protect their self-esteem 
from the experience of failure and discrimination in those settings. 

Steele labeled this phenomenon “deidentification” (see also Fordham 
and Ogbu, 1986). It is critical to note here that deidentification occurs 
because of the social conditions that groups of people experience in 
school or other institutional settings. Consequently, the processes asso- 
ciated with deidentification are quite amenable to intervention and policy 
changes, and Steele and his colleagues have developed and tested model 
programs for such interventions (see work by Stelle and Aronson, 1995). 
Such programs consist of experiences designed to prepare the early ado- 
lescent for the stereotypes they are likely to confront about their ability 
to do well in school, provide them with alternative explanations for their 
academic difficulties, provide them with experiences of success in mas- 
tering these academic tasks, and provide them with tutoring to bolster 
their basic skills. 

The issues addressed by Steele and Ogbu need to be researched for 
other populations. It seems likely that any personal or cultural charac- 
teristic that lowers the value attached to academic achievement will serve 
to both reduce the connection between academic success and subsequent 
mental health and lessen adolescents’ commitment to working hard to 
do well in school. Furthermore, it is likely that cultural norms and val- 
ues that stress adult outcomes not linked to education and competitive 
occupational pursuits will also reduce the value attached to school-based 
academic achievement during the adolescent years. Finally, school prac- 
tices that stress behaviors and values at odds with local cultural norms 
and values (such as a school’s valuing of competition and individual suc- 
cess more highly than the cooperative success and joint problem solving 
valued in some cultural communities) are likely to reduce the value that 
members of the local cultural group place on academic school achieve- 
ment. 

The research on girl-friendly math and science instruction is an ex- 
cellent example of this last point. Years of research (see Eccles et al., 
1998) have documented the fact that many girls and boys are turned off 
to math by competitive motivational strategies and individualistic work 
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activities (rather than cooperative motivational strategies and group-ori- 
ented work activities). Changing these teaching practices has a substan- 
tial impact on both girls’ and boys’ interest and performance in math and 
science courses. More work is needed to determine if similar processes 
and interventions would work to support school achievement in those 
cultural groups that currently are not doing as well in school as white 
middle-class populations. Educational programs reviewed in later chap- 
ters suggest that such interventions can work in community programs. 
The Family Math and Family Computer Literacy programs developed at 
the Lawrence Hall of Science, University of California, provide excellent 
models of such interventions (University of California, Berkeley, 2001). 
But more experimental evaluation studies of such interventions are 
needed. 

Interestingly, many intervention studies have used school academic 
success as the outcome and have attempted to change psychological and 
social characteristics in an effort to raise academic achievement. Some of 
these efforts have been quite successful in limited experimental settings 
(e.g., Felner et al., 1997; Schunk, 1994; Schweinhart and Weikart, 1997). 
Efforts to expand such interventions to scale have yielded more mixed 
results (see Eccles et al., 1998). In addition, more work is needed to see 
if these interventions can be adapted for use in programs in out-of-school 
hours. Finally, although several studies have documented the impor- 
tance of life skills training for positive development, we know little about 
which particular life skills and competencies are most important for 
youth in different cultural, ethnic, gender, and social class settings. 

Most of the work on “habits of mind” has been done by educational 
researchers. They define habits of mind in terms of approaching chal- 
lenging intellectual tasks and new learning opportunities with active rea- 
soning and “deep” and recurring inquiry and questioning, experimenta- 
tion, continual monitoring of one’s learning, continual attempts to apply 
new learning to novel situations, and being intellectually curious about 
one’s world. Both correlational studies and experimental interventions 
have demonstrated that these cognitive approaches facilitate new learn- 
ing, persistence in the face of failure, and generalization of what one has 
learned to new situations (National Research Council, 1999; DeLoache 
et al., 1998; Jackson and Davis, 2000; Pintrich and Schunk, 1996 for 
reviews). 

The work on the importance of knowledge of multiple cultures for 
well-being is also very limited because it is so new. This work has fo- 
cused primarily on how the knowledge of multiple cultural scripts and 
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norms is advantageous to minority youth who have to navigate in both 
their own culture and the majority white culture (see Banks, 1995; Castro 
et al., 2000; Phelan et al., 1992; Phelan and Davidson, 1993; Spencer 
and Markstrom-Adams, 1990; Markstrom-Adams and Spencer, 1994). 
Other work has documented the role of multiple cultural knowledge and 
friendships in facilitating interethnic relations (Banks, 1995; Hawley and 
Jackson, 1995). Much more work is needed on whether knowledge of 
multiple cultures is an asset for white middle-class youth. 



Psychological and Emotional Development 

There is quite strong longitudinal and cross-sectional support for the 
importance of mental health, good self-regulation skills of all kinds, a 
sense of autonomy and self-control, confidence in one’s self-efficacy and 
in one’s competence in valued domains (such as sports, music, school 
subjects, and getting along with others), optimism, and “planfulness” 
(Bandura, 1994; Clausen, 1993; Compas et al., 1986; Connell and Well- 
born, 1991; Deci and Ryan, 1985; Dweck, 1999; Elder and Conger, 
2000; Jessor et al., 1991; Lord et al., 1994; Luthar and Zigler, 1992; 
Mac Iver et al., 1991; Skinner, 1995; Pintrich et al., 1993; Werner and 
Smith, 1992; Zimmerman, et al., 1992; Zimmerman, 2000; see Eccles et 
al., 1998, and Scales and Leffert, 1999, for additional references). The 
relations appear to be equally strong among all groups studied. How- 
ever, little research has been conducted on American Indian youth, re- 
cent immigrant populations, or Hispanics. Finally, intervention efforts 
to change some of these assets have shown positive consequences for 
other indicators of positive development, such as school success, positive 
transitions into the labor market, and both avoidance of and reduction 
in problem behaviors. 

Most often, however, the studies (both correlational and experimen- 
tal) have included only one or two psychological characteristics and only 
one or two outcomes, so little is known about the relative importance of 
these various psychological characteristics for different outcomes. What 
we do know is that the associations are particularly strong when there is 
close correspondence between the characteristic being trained and the 
outcome being studied. For example, training in resistance skills is quite 
effective at increasing both confidence in one’s ability to resist peer pres- 
sure and actual ability to resist peer pressure; similarly, conflict manage- 
ment training is effective at producing declines in aggressive behaviors 
and conduct disorder (Bandura, 1994; Donahue, 1987; Ellickson and 
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Hayes, 1990, 1991; Johnson and Johnson, 1996; Miller et al., 1998; see 
also Scales and Leffert, 1999). These patterns of findings suggest that 
programs should be careful in selecting evaluation indicators that closely 
match the characteristics targeted for support and training. 

Consistent findings among a limited number of high-quality correla- 
tional (both concurrent — data collected only at one point in time — and 
longitudinal — data collected over a period of time) studies are emerging 
to support the predictive importance of such characteristics as prosocial 
values, spirituality and a sense of purpose, moral character (e.g., Benson 
and Donahue, 1989; Benson et al., 1997; Eisenberg and Fabes, 1998; 
Hanson and Ginsburg, 1987; Kirby et al., 1994; Litchfield et al., 1997; 
Wentzel, 1991; Werner and Smith, 1992), a strong sense of personal 
responsibility (Elder and Conger, 1999), a strong sense of mattering and 
meaning in life (DuRant et al., 1995; Elder and Conger, 2000; Werner 
and Smith, 1992), and a positive and coherent personal identity 
(Abramowitz et al., 1984; Erikson, 1968; Marcia, 1980; Waterman, 
1982). However, many of these studies have been correlational, short 
term, and have included only one or two assets. Consequently, little is 
known about the relative predictive importance of these assets. We also 
know very little about how to influence these characteristics and whether 
increases in them will actually produce changes in other characteristics in 
the short term as well as in successful transition into adulthood over the 
long term. 

Similarly, good support is emerging for the potential importance of 
positive and coherent social identities (identities related to one’s mem- 
bership in a social group, such as male or female, black, Hispanic, Jew- 
ish, Catholic, Irish, etc.). A few recent studies have found that having a 
strong positive ethnic identity is associated with having high self-esteem, 
a strong commitment to doing well in school, a strong sense of purpose 
in life, great confidence in one’s own personal efficacy, and high aca- 
demic achievement (e.g., Beauvais, 2000; Boykin, 1986; Cross, 1991, 
1995; Ford and Harris, 1996; Phelan and Davidson, 1993; Phinney, 
1990, 1990; Fisher et al., 1998; Spencer, 1995; Tatum, 1997). Research- 
ers studying the importance of ethnic identities stress the importance of 
adolescents of non-European ethnic heritage having the opportunity to 
explore their ethnic identities and other’s ethnicity without fear of being 
stereotyped, harassed, or rejected (Fine et al., 1997; Tatum, 1997). Com- 
munity programs may provide such opportunities. 

Interestingly, these same studies indicate that discriminatory racial 
experiences have a less negative association with subsequent psychologi- 
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cal and emotional development for black adolescents with strong Afri- 
can American identities. The data suggest that these youth respond to 
the experiences of racial discrimination with an increased commitment 
to doing well in school and to equipping themselves with all of the social 
and intellectual skills needed to succeed in mainstream society (Wong 
and Taylor, 1998). 

More comprehensive long-term longitudinal work and more work 
focused on actually changing these assets and then assessing the effect of 
such changes on well-being are urgently needed. In addition, little is 
known about the importance of these characteristics across cultural, eth- 
nic, social class, and gender groups. The little available evidence sug- 
gests that most of these characteristics are important in all cultural groups 
(see Scales and Leffert, 1999). However, this work is still in its infancy. 



Social Development 

There is very strong concurrent and longitudinal correlational evi- 
dence of the predictive importance of connectedness, being valued by the 
larger society, and institutional attachments for positive youth develop- 
ment. These social assets predict school success, mastery of all types of 
“taught” skills, long-term educational and occupational attainment, good 
mental health, positive personal and social identities, confidence in one's 
efficacy, optimism, and good self-regulation skills of all kinds. These 
social assets also predict both the avoidance of involvement in problem 
behaviors and a relatively smooth transition into such key adult roles as 
intimate partner, spouse, parent, worker, and active community member 
(e.g., Cairns and Cairns, 1994; Connell et al., 1995; Conger and Elder, 
2000; Furstenberg et al., 1999; Wentzel, 1991; Werner and Smith, 1992). 
These relations hold for all groups studied. However, there have been 
very few experimental studies focused on assessing whether changes in 
these social assets are causally related to changes in either current well- 
being or future successful transition into adulthood. 

The need to belong has been suggested to be one of the strongest 
human motivational needs (Bowlby, 1969, 1988; Rossi and Rossi, 1990). 
As a result, individuals act as though they are highly motivated to be- 
come a part of a larger social group, even if such associations are not 
always good for them in the long run. Becoming integrated into a group 
usually entails adopting the group's social norms, behaviors, and values. 
As identification with the group becomes stronger and more long-lived, 
the individual is likely to internalize these values and norms. It is this 

0 

ERIC 



99 



82 



Community Programs to Promote Youth Development 



internalization of values and norms that is likely to underlie the impact 
of social group membership on specific behaviors (Deci and Ryan, 1985). 
Under optimal conditions, these processes lead to the internalization of 
prosocial and moral values and goals. It is important to note, however, 
that individuals can form quite strong connections with antisocial or 
problematic groups or individuals. This is very likely to happen when 
connections with more prosocial groups and organizations do not form 
because the individual either fails in these healthier environments or is 
excluded or pushed out by the prosocial groups themselves (Cairns and 
Cairns, 1994; Fine, 1991; Sampson and Laub, 1993). Community pro- 
grams provide an excellent venue for providing the opportunity to be- 
come socially attached to positive social institutions and peer groups 
with positive social values. 

There is less evidence for the importance of either the ability and 
desire to participate in multiple cultural settings or a commitment to 
civic engagement and service — not because the evidence is negative but 
because there have been so few studies focusing on these social develop- 
mental characteristics. The few existing studies provide preliminary sup- 
port (e.g., Phalen et al., 1992; Yates and Youniss, 1998, 1999), but more 
research is needed, particularly given the strong theoretical reasons to 
believe that these two characteristics should be important in a multi- 
cultural society. 



Conclusions 

We have reviewed what is known about the relation of a set of per- 
sonal and social assets widely acknowledged as important for develop- 
ment to both adolescent well-being and functioning and the successful 
transition into adulthood. We used three types of empirical studies in 
this review: studies linking the personal and social assets listed in Box 3- 
1 to indicators of positive current development, studies linking these char- 
acteristics to indicators of future positive adult development, and experi- 
mental studies designed to change the asset under study. The indicators 
of current well-being include good mental health, good school perfor- 
mance, good peer relations, good problem-solving skills, and very low 
levels (or the absence) of involvement in a variety of problem behaviors, 
such as gang membership, drug and alcohol use, school failure, school 
dropout, delinquency, and early pregnancy. Indicators of positive devel- 
opment during late adolescence and adulthood include completing high 
school, completing higher education, adequate transition into the labor 
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market (obtaining and keeping a job that pays at least a living wage), 
staying out of prison, avoiding drug and alcohol abuse, and entering a 
stable and supportive intimate relationship (often through marriage). 
Some recent studies also include involvement in civic and community 
activities as indicators of positive adult development. 

We found strong correlational support for the relation of most of the 
assets listed in Box 3-1 with indicators of both positive development 
during adolescents and the successful transition into adulthood. Because 
of the recency of interest in the role of cultural understanding and toler- 
ance and social identities, few studies document the association of these 
assets to well-being. The strongest experimental evidence of a causal 
relation between personal assets and other indicators of positive devel- 
opment exists for intellectual and social or life skills. 



Limitations of the Research Base 

Most of the studies reviewed used only a small subset of these indi- 
cators of positive development — often only one. Too many of the stud- 
ies relied on data collected only at one point in time (called concurrent 
studies). Findings from such studies are difficult to interpret because the 
causal directions underlying the relations are unclear. In addition, the 
majority of the concurrent studies focused on white middle-class popula- 
tions. In contrast, several ongoing longitudinal studies have included a 
wide range of populations in many types of environments. The findings 
of these studies suggest that the findings from the concurrent studies are 
likely to also be true of groups other than white middle-class popula- 
tions. Together the concurrent and longitudinal studies provide a grow- 
ing body of consistent evidence supporting the predictive importance of 
the set of characteristics we have identified. Nevertheless, more compre- 
hensive longitudinal studies that follow children and youth into and 
through the young adult years are urgently needed. This need is particu- 
larly true for populations that are neither white, middle class, nor subur- 
ban. Work on American Indian and recent immigrant populations is 
particularly sparse. 

The issue of causal direction of influence is quite complex and is 
equally problematic for both concurrent and longitudinal research. It is 
likely that many of these assets are reciprocally related to each other — 
making the search for causal order in naturalistic studies difficult. Some 
researchers argue that such a search is actually counterproductive, pre- 
cisely because of the complex and reciprocal nature of the relations 
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among the constructs discussed in this chapter and the next. But inter- 
vention programs have to consider whether changing particular charac- 
teristics or assets, such as self-esteem or a sense of personal efficacy, will 
lead to changes in other indicators of well-being, such as school achieve- 
ment or avoidance of problem behaviors. Controlled intervention stud- 
ies are needed to address this issue; some were discussed in this chapter; 
more are discussed in later chapters. We have indicated when such stud- 
ies provide support for the importance of particular characteristics. More 
research involving active efforts to change assets and then measure the 
effect of such changes on other assets and on future indicators of well- 
being is urgently needed. 



SUMMARY 

The period of adolescence is complicated: it is full of opportunities 
and risks. Adolescents have the potential to develop into mature, strong, 
creative, and smart adults. But, some take, or are exposed to, unhealthy 
and unsafe risks that can endanger both their present health and well- 
being and their future adult opportunities. In this chapter, we provide a 
summary of what is known about the personal and social assets likely to 
facilitate positive development during this period of life. We suggested 
ways in which this information is relevant to the development of com- 
munity programs for youth. This information, in conjunction with the 
material discussed in the next chapter, can help program developers de- 
sign programs, funders decide what kinds of programs to fund, and evalu- 
ators to design or select appropriate implementation and outcome mea- 
sures. 

Based on the material summarized in this chapter, the committee 
identified a set of personal and social assets that both represent healthy 
development and well-being during adolescence and facilitate a success- 
ful transition from childhood, through adolescence, and into adulthood. 
The committee grouped these assets into four broad developmental do- 
mains: physical, intellectual, psychological and emotional, and social 
development. One does not need necessarily need the entire range of 
assets listed in this chapter to have a good life. For instance, studies that 
include more than one of these assets have found that youth can do quite 
well with various combinations of the studied assets. Nevertheless, hav- 
ing more assets is better than having a few and having positive assets in 
each of the four broad categories is beneficial. Although strong assets in 





Personal and Social Assets That Promote Well-Being 



85 



one category may be able to offset weak assets in another category, life is 
easier to manage if one has assets in all four categories. 

Although the body of evidence supporting the assets listed in this 
chapter is growing, much more comprehensive longitudinal and experi- 
mental research on a wider range of populations that follows children 
and adolescents well into adulthood is needed in order to understand 
which assets are most important to adolescent development and which 
patterns of assets are linked to particular types of successful adult transi- 
tions in various cultural settings. There is a pressing need for longitudi- 
nal studies to illuminate: 

° How these assets work together (this means more comprehensive 
studies of both assets and outcomes) and 

° How these various assets are manifested and valued in different 
cultural groups. 

There is also a pressing need for more field-based experimental studies to 
confirm the hypothesized causal relations in complex settings. 

In conclusion, it is also important to note that these personal and 
social assets do not exist in a vacuum. Evidence suggests that these assets 
influence life chances because they both (1) facilitate the engagement of 
youth in positive social settings that support continued positive develop- 
ment and (2) protect them against the adverse effects of negative life 
events, difficult social situations, pressure to engage in risky behaviors, 
and academic failures. So on one hand, the personal and social assets 
discussed in this chapter can increase life chances. On the other hand, 
excessive and prolonged exposure to negative life events, dangerous set- 
tings, and inadequate schooling are likely to undermine young people’s 
life chances despite their assets. Young people need continued exposure 
to positive experiences, settings, and people as well as abundant oppor- 
tunities to gain and refine their life skills in order to support the acquisi- 
tion and growth of these assets. 
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CHAPTER 4 



Features of Positive 
Developmental Settings 



D icture a diverse group of American adolescents: girls and 
boys; rural, urban, suburban; affluent and disadvantaged; 
1 youth living with one parent, two parents, a foster parent, 
a grandparent, or on their own; adolescents with and with- 
out physical disabilities; adolescents who are lesbian and 
gay; youth who are introverted and extroverted; youth with 
parents who are Chinese immigrants, Mexican migrant la- 
borers, Laotian, Dakotan, Salvadoran, African American, 
European American. 

Now picture each of them walking through the front 
door of a community program. How do we make sure 
that this program engages all these youth and supports 
their development? What can a program do to give each 
person who walks in the door the best chance possible of 
growing up to be a healthy adult and have the personal 
assets described in the last chapter? Having described as- 
sets of positive development in Chapter 3, this chapter sum- 
marizes what is known about the daily settings and experi- 
ences that promote this development in young people. 

Before starting, we need to recognize that even with 
the best staff and best funding, no single program is going 
to succeed in helping every participant. Adolescents have 
many other, often more powerful influences in their lives; 
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some will be more ready for change and growth than others. In addition, 
any given program will work better for some teens than for others. Fi- 
nally, we need to recognize that there is very little research that directly 
specifies what programs can do to facilitate development, let alone how 
to tailor it to the needs of individual adolescents and diverse cultural 
groups. Few studies have applied the critical standards of science to 
evaluate which features of community programs influence development. 

Despite these limitations, there is a broad base of knowledge about 
how development occurs that can and should be drawn on. Research 
demonstrates that certain features of the settings that adolescents experi- 
ence make a tremendous difference, for good or for ill, in their lives. For 
example, research on families and classrooms shows that the presence or 
absence of caring relationships affects whether an adolescent thrives or 
has problems. We think it is valid to hypothesize that this will be true in 
community programs as well. 

This chapter employs this wider base of knowledge from develop- 
mental science to generate a list of features of adolescents’ daily settings 
and experiences that are known to promote positive youth development. 
We suggest that these eight features should be seen as a provisional list — 
subject to further study — of the processes or “active ingredients” that 
community programs could use in designing programs likely to facilitate 
positive youth development. We stress that the implementation of these 
features needs to vary across programs precisely because they have di- 
verse clientele and different constraints, resources, and goals. 

There are numerous theories in developmental psychology, sociol- 
ogy, public health, anthropology, and other fields that direct attention to 
a panorama of individual, community, and cultural processes that are 
related to positive development. Appendix B is a review of the theories 
of human development that highlight ways of seeing the full framework 
within which development takes place for different youth. It describes 
how development includes multiple processes: an adolescent’s active cre- 
ativity, thoughtful mentoring and management by others, acquisition of 
social capital, and socialization into a culture. The opportunities an 
adolescent has for development are shaped by numerous personal, insti- 
tutional, and cultural factors (see Damon, 1997; Feldman and Elliott, 
1990; Grotevant, 1998; Steinberg, 2000; Steinberg and Morris, 2001). 
The major implications of these theories of human development for com- 
munity programs for youth include the importance of good developmen- 
tal, cultural, and personal fit; the important role that community organi- 
zations can play in helping adolescents build the social capital and life 
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skills necessary to successfully manage their lives in a very complex social 
system; and the importance of community programs being interconnected 
with each other, with families, and with other youth-serving institutions 
and programs in the community. 

FEATURES THAT MAXIMIZE POSITIVE DEVELOPMENT 

In this section we present a provisional list of eight features of daily 
settings that are important for adolescent development. This list is based 
partly on theories of positive developmental processes and partly on 
empirical research on the many types of settings that youth experience — 
families, schools, neighborhoods, and community programs. We have 
also drawn on lists of features created by other scholars and practitio- 
ners (e.g., American Youth Policy Forum, 1997; Benson, 1997; Connell 
et al., 2000; Dryfoos, 1990; Gambone and Arbreton, 1997; Lipsitz, 1980; 
McLaughlin, 2000; Merry, 2000; Roth and Brooks-Gunn, 2000; Zeldin 
et al., 1995). Table 4-1 is a summary of the eight features. In assessing 
the evidence for these eight characteristics, we relied on the most recent 
peer-reviewed literature reviews (e.g., those published in the 1998 Hand - 
book of Child Psychology, edited by William Damon, 1997; the recent 
Annual Reviews for psychology, sociology, and anthropology; the major 
review journals in each of these fields as well as recent articles published 
in the major peer-reviewed journals in these fields). Instead of a lengthy 
list of citations following each conclusion, we cite representative articles 
and reviews. 

Two qualifications need to be kept in mind. First, we emphasize 
that this list is provisional: it is based on the current research base, thus 
it is likely to have omitted features important to various cultural groups. 
Second, the boundaries between features are often quite blurred. This 
list, then, is only a step on the path toward formulating a more compre- 
hensive framework; more research needs to be done. Although we de- 
scribe these as features of settings, this is really shorthand for saying that 
they are features of the person’s interaction with the setting. 
Bronfenbrenner and Morris (1998) have decried a recent tendency for 
scholars to discuss the setting without the child and to discuss the child 
without the setting. We want to avoid encouraging these shortcomings. 
It is the experience of the adolescent-in-setting — the processes of interac- 
tion — that is critical to development. When adolescents walk in the door, 
it is not what they see that is important, but rather it is how they become 
engaged. 
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Physical and Psychological Safety 

At the most basic level, safety is essential for positive development. 
Safety is both a physical and a psychological phenomenon. Starting with 
the physical side, positive settings must be free from violence and unsafe 
health conditions because of their direct impact on physical health and 
survival. Childhood sexual abuse appears again and again as a causal 
factor in numerous adult psychological disorders (Finkelhor, 1990; Briere 
and Runtz, 1991); it is a profound breach to the trusting relationships 
that attachment and object relations theorists see as critical to positive 
development. Both school health professionals (Institute of Medicine, 
1997b) and professionals working in the area of youth development pro- 
gramming design, implementation, and evaluation (Pittman et al., 2000b) 
have articulated a variety of other safety issues, including freedom from 
exposure to environmental hazards, infectious agents, and both uninten- 
tional and intentional injuries. The corollary is that adults in charge of 
youth need to do more than just mouth the importance of safety; they 
need to take extra steps to instill practices that reduce the probability of 
unforeseen threats. Having guns in the home, for example, increases the 
likelihood of their use by adolescents (Blum and Rinehart, 1997). Simi- 
larly, fears of physical hazards and violence have made parents wary of 
their children’s schools and community centers. 

The psychological side of safety is also of great importance. The 
experience, witnessing, or even the threat of violence sends psychological 
ripples through a community of adolescents that can be severe and long- 
lasting. Youth who are victims of violence, as well as those who witness 
violence, show continuing symptoms of posttraumatic stress disorder, 
including depression, dissociative reactions, helplessness, emotional 
disregulation, aggression, intrusive thoughts, and flashbacks (Dubrow 
and Garbarino, 1989; Martinez and Richters, 1993). Experience of vio- 
lence and harassment in school (being picked on, hit, or talked about 
unkindly) are related to skipping school, more negative attitudes toward 
school, lower achievement levels, and fewer friendships (Jackson and 
Davis, 2000; Scales and Leffert, 1999). Finally, biological research shows 
that prolonged stress, such as that from experience with the threat of 
violence, is associated with suppression of immune response and delete- 
rious effects on the brain, with likely effects on the capacity to learn 
(Cynader and Frost, 1999). 

There are also community-level effects of violence. Violence tends to 
breed more violence. When youth are victimized by others, they often 
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TABLE 4-1 Features of Positive Developmental Settings 



Descriptors Opposite Poles 



Physical and 

Psychological 

Safety 


Safe and health-promoting facilities; 
and practices that increase safe peer 
group interaction and decrease 
unsafe or confrontational peer 
interactions. 


Physical and health 
dangers; fear; feeling of 
insecurity; sexual and 
physical harassment; and 
verbal abuse. 


Appropriate 

Structure 


Limit setting; clear and consistent rules 
and expectations; firm-enough control; 
continuity and predictability; clear 
boundaries; and age-appropriate 
monitoring. 


Chaotic; disorganized; 
laissez-faire; rigid; 
overcontrolled; and 
autocratic. 


Supportive 

Relationships 


Warmth; closeness; connectedness; 
good communication; caring; support; 
guidance; secure attachment; and 
responsiveness. 


Cold; distant; 

overcontrolling; ambiguous 
support; untrustworthy; 
focused on winning; 
inattentive; unresponsive; 
and rejecting. 


Opportunities to 
Belong 


Opportunities for meaningful inclusion, 
regardless of one’s gender, ethnicity, 
sexual orientation, or disabilities; 
social inclusion, social engagement, 
and integration; opportunities for 
sociocultural identity formation; and 
support for cultural and bicultural 
competence. 


Exclusion; marginalization; 

and intergroup 

conflict. 


Positive 
Social Norms 


Rules of behavior; expectations; 
injunctions; ways of doing things; 
values and morals; and obligations 
for service. 


Normlessness; anomie; 
laissez-faire practices; 
antisocial and amoral 
norms; norms that 
encourage violence; 
reckless behavior; 
consumerism; poor health 
practices; and conformity. 


Support for 
Efficacy and 
Mattering 


Youth-based; empowerment practices 
that support autonomy; making a real 
difference in one’s community; and 
being taken seriously. Practice that 
includes enabling, responsibility 
granting, and meaningful challenge. 
Practices that focus on improvement 
rather than on relative current 
performance levels. 


Unchallenging; 
overcontrolling; 
disempowering, and 
disabling. Practices that 
undermine motivation and 
desire to learn, such as 
excessive focus on current 
relativeperformance level 
rather than improvement. 
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Descriptors 


Opposite Poles 


Opportunities for 
Skill Building 


Opportunities to learn physical, 
intellectual, psychological, emotional, 
and social skills; exposure to 
intentional learning experiences; 
opportunities to learn cultural literacies, 
media literacy, communication skills, 
and good habits of mind; preparation 
for adult employment; and 
opportunities to develop social and 
cultural capital. 


Practices that promote bad 
physical habits and habits 
of mind; and practices that 
undermine school and 
learning. 


Integration of 
Family, School, 
and Community 
Efforts 


Concordance; coordination; and 
synergy among family, school, and 
community. 


Discordance; lack of 
communication; and 
conflict. 



react with retributive violence, and gang formation or membership is 
often not far behind (Prothrow-Stith and Weissman, 1991). A high 
prevalence of violence changes the social norms of a community. Even 
when a community program is safe, getting to and from it without risk is 
critical. 

In conclusion, physical and psychological safety are prerequisites to 
all the categories of positive development we described in the last chapter. 
In addition to the direct effects of harm on physical well-being and devel- 
opment, violence or the threat of violence interferes with the allocation 
of attention to intellectual, psychological, emotional, and social develop- 
ment. They create psychological trauma that requires adolescents to 
cope in maladaptive ways, psychologically, emotionally, and behavior- 
ally. 



Clear and Consistent Structure and Appropriate Adult Supervision 

One of the first things a new participant experiences in a community 
program for youth is whether the environment is structured or chaotic. 
According to theories and empirical research, development requires that 
a child experience a stable, predictable reality. Cognitive theories (Piaget, 
1964, 1971; Piaget and Inhelder, 1973) stress the need for a stable environ- 
ment to which children can assimilate and accommodate their emerging 
cognitive structures; object relations theorists also stress the predictabil- 
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ity of caretakers as essential to the development of trust and confidence 
(Mahler et al., 1975; Winnicott, 1975). Similarly, applied researchers 
have shown that, in all settings studied, adolescents benefit from experi- 
encing clear rules, discipline, and consistently enforced limits on their 
behavior (Connell and Wellborn, 1991; Dryfoos, 1990; Jackson and 
Davis, 2000; Lipsitz, 1980; Roth and Brooks-Gunn, 2000). More class- 
room and school discipline is a major cause of poor academic achieve- 
ment and psychological disengagement from school. 

Structure is a critical feature of all settings. On one hand, research 
on families shows that firm parenting and clear behavioral expectations, 
when coupled with warmth and emotional support, are associated with 
more positive developmental outcomes than lax parenting (Steinberg et 
al., 1992; Steinberg, 2000). Evidence is also emerging that the best ado- 
lescent outcomes are associated with parents gradually reducing their 
control over their adolescents and providing them with increasing op- 
portunities to help establish family rules and participate in family deci- 
sion making. Adolescents desire both consistency and structure and in- 
creasing opportunity to manage their own behavior. They appear to do 
better in families that over time provide both of these experiences (see 
Eccles et al., 1993, for a review). 

Similarly in classrooms, maintenance of discipline, control, and or- 
ganization by the teacher is related to student satisfaction, growth, and 
achievement. Once again, however, as they grow older, students desire 
increasing opportunity to have input into classroom and school gover- 
nance and rules. Evidence suggests that their motivation is optimized 
when they experience this type of change in classroom and school man- 
agement over time (Epstein and McPartland, 1979; Jackson and Davis, 
2000; Lipsitz et al., 1997; Maehr and Midgley, 1996; see Eccles et al., 
1998, for a review). 

On the other hand, research on peer relations shows that the amount 
of time adolescents spend with peers in unstructured activities, like driv- 
ing around in cars, predicts increases in involvement in problem behav- 
iors (Osgood et al., 1996). One important study found that participa- 
tion in community programs that lacked structure predicted greater 
involvement in problem behaviors both in the present and 20 years later 
(Mahoney et al., in press). 

A critical element of structure is consistent monitoring and enforce- 
ment of rules and expectations. Across settings, there is more positive 
development and fewer problem behaviors with consistent monitoring 
by parents (Grotevant, 1998; Pettit et al., 1999; Steinberg, 2000), teach- 
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ers (Eccles et ah, 1993; Maehr and Midgley, 1996), and community 
members (Fisher et ah, 1998; Scales and Leffert, 1999). In sports-based 
community programs, for example, a distinctive feature of effective 
coaches is that they repeatedly emphasized adherence to the rules of the 
game (Heath, 1994). Finally, a key characteristic of successful commu- 
nity programs is that they have clear rules about expected behavior when 
in the program, and the staff are regularly involved in monitoring par- 
ticipants’ behavior, even when youth are elsewhere (Dryfoos, 1990; 
Heath, 1999; McLaughlin, 2000; Merry, 2000; Roth et ah, 1998a). 

As with all eight features, it is critical that structure be developmen- 
tally, ecologically, and culturally appropriate. With regard to age, as 
individuals’ mature, they need less external structure and control to sup- 
port their well-being. In most cases, they become increasingly able to 
create their own structure and to provide adequate self-control over their 
behavior. Consequently, the exact extent of structure and adult supervi- 
sion needed to support positive behavior and development will change as 
children and adolescents grow older. Younger youth need more struc- 
ture than older youth; older youth may balk at leadership that is too 
rigid, overcontrolling, or authoritarian. Consequently, structure must 
permit age-appropriate levels of autonomy. The way this shows up in 
studies is as a curvilinear relation between structure and outcomes: both 
too little and too much adult-imposed structure is related to poorer out- 
comes than moderate levels of adult-imposed structure. The exact opti- 
mal point in the curve moves toward less adult-imposed structure as the 
population being studied gets older (see Eccles et al., 1993, for an ex- 
ample of this dynamic relation in classroom research). 

Both neighborhood conditions and culture also influence what is the 
most optimal level of structure and adult control. Greater limits on be- 
havior may also be necessary in dangerous neighborhoods, where the 
costs of stepping outside the bounds of authority are higher (Steinberg et 
al., 1992; Sampson and Morenoff, 1997, cited by Roth and Brooks- 
Gunn, 2000). We should also recognize that cultures differ in their ex- 
pectations regarding appropriate levels of structure. For example, in 
India, a more hierarchical culture than that of the United States, Cub 
Scout troops define obedience to leaders as a fundamental obligation; in 
contrast, in the United States, the Cub Scout pledge focuses on “obeying 
the law of the Pack.” 

Much evidence indicates that appropriate structure is a necessary 
condition to positive development. Without stability and order, adoles- 
cents cannot engage in physical, cognitive, emotional, or social growth, 
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and they are at risk for the development of negative behavioral patterns. 
It is notable that Csikszentmihalyi (1975, 1990) found structure to be a 
prerequisite to engagement itself. To become psychologically engaged in 
an activity, people need structure and predictability. But too much adult 
control can drive older youth away. Youth participation is increased 
when opportunities are provided for them to take on more active roles in 
governance, rule setting, and leadership as they get older and more expe- 
rienced in the setting (McLaughlin, 2000; Merry, 2000; we discuss this 
more in Chapter 5). Nonetheless, without sufficient structure, all the 
other features of good environments become irrelevant. 



Supportive Relationships 

Whether you ask a researcher, a theorist, a practitioner, or an ado- 
lescent, the quality of relationships with adults comes up again and again 
as a critical feature of any developmental setting. Researchers speak of 
the importance of warmth, connectedness, good communication, and 
support (Blum and Rinehart, 1997; Brooks-Gunn and Paikoff, 1993; 
Dryfoos, 1990; Eccles et al., 1998; Ford and Harris, 1996; Grotevant, 
1998; Lipsitz, 1980; Roth and Brooks-Gunn, 2000). Theorists talk about 
adults who provide secure attachments, are good mentors and managers, 
and provide scaffolding for learning (Bowlby, 1969; Furstenburg et al., 
1999; Vygotsky, 1978). Practitioners talk about caring and competent 
adults. Adolescents themselves may use more evocative terms to de- 
scribe positive adults — like being loving or just “cool” (McLaughlin, 
2000 ). 

As a whole, these descriptions suggest a family of related qualities 
that make for good relationships with adults. They include interrelated 
qualities of emotional support (e.g., being caring and responsive) and 
qualities of instrumental support (e.g., providing guidance that is useful 
to young people). On the surface these appear to be objective qualities, 
but research suggests that these qualities reside less in the adult than in 
the adolescent’s perception of the adult and in the adolescent’s experi- 
ence of interactions with the adult (Clark, 1983; Eccles et al., 1992; 
Noller and Callan, 1986). This is an important point, because it suggests 
that there is not one perfect type of adult for all adolescents and all 
settings (i.e., there is no single template of a good parent, teacher, or 
leader) but rather that different adolescents are likely to respond to dif- 
ferent elements within this family of desirable qualities. This point is 
also important because it suggests that, inasmuch as there is an underly- 
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ing essential element here, it consists of attentiveness and responsiveness 
to adolescents’ subjective worlds. 

The largest body of research on relationships with adults focuses on 
the qualities of parents that are associated with positive development. 
Longitudinal studies consistently show that parental support is associ- 
ated with positive school motivation (Clark, 1983; Eccles et al., 1992; 
Epstein and Dauber, 1991; Eccles and Harold, 1996; Henderson and 
Berla, 1994; Booth and Dunn, 1996; Marjoribanks, 1979), better mental 
health, and lower rates of drinking, drug use, delinquency, and school 
misconduct (Furstenberg et al., 1999; Grotevant, 1998; Steinberg, 2000). 
Similar findings are suggested for feeling connected to a parent or parents 
(Blum and Rinehart, 1997) and having good communication (Brooks- 
Gunn and Paikoff, 1993; Steinberg, 2000). Parental support provides a 
buffer against the effects of negative racial stereotypes, and parental guid- 
ance promotes cultural pride (Comer, 1988; Fisher et al., 1998; Ford 
and Harris, 1996; Romo and Falbo, 1996). On the negative side, am- 
biguous and insecure relationships with parents (e.g., when there is fear 
of rejection as well as substantial disruptions in parenting relationships) 
are associated with adolescent involvement in problem behaviors. 

Similar findings show the importance of supportive relationships 
with adults in other settings. In the classroom, positive support from 
teachers is related to greater educational success, and when teachers have 
positive expectations for students, they do better (Comer, 1988; Eccles et 
ah, 1998; Ford, 1996; Ferguson, 1998; Jackson and Davis, 2000; Lee 
and Smith, 1993; Rosenthal and Jacobson, 1968). In addition, when 
students care about what teachers think and expect of them, they do 
better both academically and socially and care more about doing well in 
school (Jackson and Davis, 2000). The importance of one caring adult 
at school has also been documented by studies of resilience and of the 
role of school advisors (Masten, 1994; Galassi et ah, 1997). In sports 
programs, youth develop greater self-esteem and lower anxiety when 
coaches focus on the development of skills rather than winning (Seefeldt 
et ah, 1995; Roberts and Treasure, 1992). For example, Smoll et ah 
(1993) found that a three-hour intervention that trained coaches to be 
emotionally supportive was effective in increasing the self-esteem of their 
Little League players. Similarly, an evaluation of the Big Brothers, Big 
Sisters program, in which a relationship with an adult is the heart of the 
program, showed that adolescent outcomes were especially positive for 
mentors who developed “youth-centered” relationships with adolescent 
mentees, rather than more controlling relationships (Grossman and 
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Rhodes, in press). Research in other settings reinforces the finding that 
adult overcontrol is related to less positive outcomes (Eccles et al., 1993; 
Grolnick and Ryan, 1987, 1989; Hauser et al., 1991; Roth and Brooks- 
Gunn, 2000). Grossman and Rhodes also found that longer-term rela- 
tionships were associated with better youth outcomes (indeed, relation- 
ships that were terminated quickly were associated with decrements in 
several indicators of functioning). These findings underscore the impor- 
tance of qualities of communication, respect, and long-term stability. 

We stress again that these qualities have to be fit to the adolescent; 
this is implicit in the notion of responsiveness. Different cultural groups 
have different models of adult-adolescent relationships, and hence sup- 
port needs to fit with the cultural model of the adolescent’s social group. 
For some, this will involve more deference to authority (e.g., Doi, 1990); 
for others, it will involve the granting of autonomy in conjunction with 
strong emotional support (LaFromboise and Graff Low, 1998). Appro- 
priate types of mentoring may vary by the gender, age, or previous expe- 
riences of the adolescent. In general, adolescents need less direct guid- 
ance and minute-to-minute support as they grow older and become better 
able to regulate their own emotions and behavior (Rogoff et al., 1995). 

In summary, supportive relationships are critical “mediums” of de- 
velopment. They provide an environment of reinforcement, good mod- 
eling, and constructive feedback for physical, intellectual, psychological, 
and social growth. Parental support strengthens a child’s ability to take 
on challenge (Csikszentmihalyi and Rathunde, 1998). In Vygotsky’s 
theoretical view (Vygotsky, 1978), the attentive, caring, and wise voice 
of a supportive adult gets internalized and becomes part of the youth’s 
own voice. 



Opportunities to Belong 

Research across settings substantiates the importance of opportuni- 
ties to develop a sense of belonging. Families that provide multiple op- 
portunities for the children to be actively involved in family decision 
making and activities have adolescents who are less antisocial and who 
exhibit better self-regulation and social responsibility (Grotevant, 1998). 
Similarly, teachers who provide opportunities for all students to partici- 
pate and feel valued have students who do better on a wide range of 
academic outcomes (Goodenow, 1993; Ford and Harris, 1996; Eccles et 
al., 1996b, 1998; Maehr and Midgley, 1996). Adolescents who feel con- 
nected to their schools report lower levels of emotional stress, violent 
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behavior, and substance abuse and are more likely to delay initiation of 
sexual intercourse (Blum and Rinehart, 1997). Conversely, students who 
feel alienated and left out or rejected by their teachers and schools are 
more likely to drop out of school (Fine, 1991; Roderick, 1991, 1993). 
Adolescents who perceive peers as prejudiced report higher levels of 
emotional stress than those who do not (Blum and Rinehart, 1997). Re- 
search with American Indians has found that bicultural school curricula 
that bridge Indian and European cultures had a positive influence 
(LaFromboise et al., 1993). Gambone and Arbreton (1997) concluded 
that settings that provide a sense of membership and belonging to a group 
and allow for adolescents to be recognized and valued decrease the like- 
lihood that they will become involved in high-risk behaviors, increase 
their sense of responsibility, and improve self-competence, school atti- 
tude, and performance. Finally, similar though incomplete findings sug- 
gest the value of opportunities to belong in community programs. Pro- 
gramming strategies for positive bonding have proven effective for 
adolescents at risk for antisocial behavior (Catalano et al., 1999; Dryfoos, 
1990; Lipsitz, 1980; Merry, 2000). 

In a multicultural society like ours, the issue of belonging is espe- 
cially important. One of the first issues for an adolescent walking 
through the door or even thinking about trying a community program is 
whether he or she can belong to this group of people: “Will I fit in, will 
I be comfortable?” The adolescent may ask, not only is my ethnic group 
welcome, but also will the people here accept someone of my gender, 
sexual orientation, disability status, or the peer crowd that people think 
I belong to (e.g., jock, nerd)? Research suggests that these considerations 
can be significant barriers that keep adolescents from joining youth ac- 
tivities (Larson, 1994). Beyond the issue of interpersonal comfort, we 
also discuss here the constructive role that community programs can play 
in helping adolescents address underlying developmental issues related 
to sociocultural belonging. Whether one is a member of a minority 
group, the dominant culture, or has not decided, there are important 
issues to be faced about how one fits into the diverse and sometimes 
conflicting marketplace of cultural messages and identities. Along with 
schools, community programs provide a particularly valuable setting for 
youth to work on these important developmental tasks (Merry, 2000; 
National Research Council and Institute of Medicine, 2000a). 

The theoretical foundation for this feature lies in a number of cul- 
tural theories: anthropologists’ emphasis on intrinsic links between per- 
son and culture (LeVine et al., 1988), sociologists’ insights into integra- 
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tion versus alienation (Durkheim, 1951), educational psychologists’ em- 
phasis on the importance of belonging for school engagement 
(Goodenow, 1993), and Erikson’s descriptions of identity development 
as a process of situating oneself within a sociocultural milieu (Erikson, 
1968). Cultures provide meaning, and meaning is fundamental to well- 
being. Research shows that youth with stronger ethnic identity have 
more positive self-esteem, stronger ego identity, and greater school in- 
volvement (Phinney et al., 1997a; Wong et al., submitted), and they are 
less likely to engage in violence (National Research Council and Institute 
of Medicine, 1999c). But a sense of belonging to a group becomes a two- 
edged sword if it means exclusion or hostility in relation to others. 
LaFromboise, Coleman, and Gerton (1993) suggest that the desirable 
developmental outcome is “bicultural competence,” which involves 
development of abilities to function and be comfortable in multiple cul- 
tural settings (see also Phinney et ah, 1997b). Although issues of ethnic 
identity are found to be least salient for European American adolescents 
(Roberts et ah, 1999), awareness of intergroup processes is important for 
them, too. The ability of other youth to achieve and enjoy bicultural 
competence is dependent on whether people in the majority culture are 
sensitive to and knowledgeable about other cultures and aware of the 
ways in which their privilege is experienced by others. 

Interestingly, some of the best evidence for the importance of be- 
longing comes from studies of programs designed to be welcoming to 
adolescents often ignored by mainstream programs. A study of a drop- 
in center for lesbian, gay, and bisexual youth in Chicago, for example, 
found that the opportunity to be connected to a community of similar 
youth and adults made a great difference in the well-being of these youth 
and helped them adjust to their sexual minority status (Herdt and Boxer, 
1993). Another study found that community programs that were sensi- 
tive to the special needs of youth with disabilities had positive benefits 
for the youth, their families, and other participants (Fink, 1997). 

Other good evidence comes from programs designed to be welcom- 
ing to adolescents from multiple cultural groups. For example, black 
adolescents living in predominantly white neighborhoods and participat- 
ing in Jack and Jill, a program for black youth, reported that this pro- 
gram facilitated their adjustment to the challenges of the situation 
(Nicholson, 1999). Similar evidence of the negative consequences of 
feeling devalued by one’s teachers and school peers because of one’s cul- 
tural background, language, ethnicity, and religion provides more sup- 



Features of Positive Developmental Settings 



99 



port for the importance of belonging for a wide variety of positive out- 
comes (Fisher et ah, 1998; Jackson and Davis, 2000). 

How is inclusiveness across cultural groups achieved? Simply bring- 
ing different groups into contact with each other does not necessarily 
lead to mutual understanding and respect; the conditions of contact are 
critical (Merry, 2000; National Research Council and Institute of Medi- 
cine, 2000b). Experimental studies introducing multiethnic cooperative 
learning groups have demonstrated that such experiences increase cross- 
ethnic group friendships and, in turn, increase a sense of belonging in the 
school and the classroom (Slavin, 1995). The following elements were 
identified by a recent gathering of scholars as critical to cultivating posi- 
tive intergroup relationships through inclusiveness (National Research 
Council and Institute of Medicine, 2000b: 15): 

° Interactions between different groups must be on a level of equal 
status; 

0 Activities must be cooperative rather than competitive, involving 
pursuit of a shared goal; 

° There must be individualized contact between members of groups; 

° Institutions and authority figures must support the goal of inter- 
group understanding; “institutional silence,” an atmosphere in 
which race is never mentioned, can lead to unspoken perceptions 
of discrimination and intergroup tensions; group differences must 
be acknowledged; and 

° Adults have an important roles, as “role models, pathfinders, 
arbitrators, peacemakers, interpreters, mentors, promoters of civic 
ethics, and administrators.” 

As with all other features, issues of person-environment fit are im- 
portant here (see Appendix B for more details). Adolescents have differ- 
ent attitudes, past experiences, and levels of readiness. For example, 
research suggests that issues of ethnic identity become more salient with 
age (National Research Council and Institute of Medicine, 2000b), and 
thus younger adolescents may have different concerns from older ones. 
In addition, stage theories of ethnic identity formation suggest that some 
youth from nonmajority cultures may need intense periods of immersion 
in their own culture as a step toward being able to function in a multi- 
cultural environment (Phinney, 1990). Similar issues can be important 
for male and female youth and for youth with different sexual orienta- 
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Positive Social Norms 

Every group of people that has sustained interaction develops a set 
of habits, norms, and expectations that govern their behavior (Berger 
and Luckmann, 1966; Coleman, 1990; Shweder et al., 1998). Whether 
we are talking about a family, a peer group, a classroom, or a commu- 
nity program for youth, the group develops a way of doing things and 
not doing things; deviations from these group norms are often strongly 
sanctioned. The group “culture” includes not only the formal organiza- 
tional culture but also the informal habits and expectations that arise 
from daily interactions; these informal norms may diverge from the offi- 
cial organizational norms and expectations. Research across multiple 
settings suggests that adolescents’ perceptions of these kinds of social 
norms have immediate and lasting effects on their behavior. For ex- 
ample, when adolescent girls perceive that their parents disapprove of 
sexual activity, they are less likely to become pregnant (Blum and 
Rinehart, 1997). In discussing opportunities to belong, we stressed the 
role of the group culture in relation to identity and meaning. Here we 
stress its role in shaping behavior. 

The impact of peer norms on adolescent behavior has often been 
discussed under the rubric of “peer influence.” While adults often de- 
monize the negative effects of peer pressure, research suggests that peer 
influence is typically more subtle and multidimensional. Rather than 
being pressured, adolescents often perceive certain behaviors to be nor- 
mative and so come to view them as appropriate ways of acting (Brown, 
1990). Research also shows that peer influence toward positive behavior 
(finishing school, excelling at something, not using drugs) is much more 
common than influence toward deviant behaviors (Brown, 1990; Scales 
and Leffert, 1999; Steinberg, 2000). For example, peer modeling is an 
important motivating force for participation in service activities (Stukas 
et al., 1999). Nevertheless, for a subset of teens, peers are an important 
influence on use of substances, delinquent behavior, and sexual activity 
(Brown, 1990; Scales and Leffert, 1999). Most of the research is based 
on adolescents’ perceptions of their peers’ behavior, and their percep- 
tions of peer norms often do not correspond very closely with the actual 
behaviors of their peers. For example, adolescents who take up smoking 
or initiate sexual intercourse often overestimate the prevalence of these 
behaviors by their peers (Scales and Leffert, 1999). But whether accurate 
or inaccurate, perceptions of peer norms do have a lasting influence on 
behavior (Guerra et al., 1994), and interventions designed to change stu- 
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dents’ perceptions about peer norms regarding problem behaviors do 
reduce their incidence (Cook et al., 1993). 

Although not a social group itself, the media is also an important 
source of adolescents’ views about social norms. Youth and adults who 
watch more television believe the world is a more violent and dangerous 
place than do those who watch less television, and they are more likely to 
believe that violence is an appropriate problem-solving strategy. They 
also score higher on a scale of sexism and have more distorted views of 
the world of work (Gerbner et ah, 1994). On the positive side, health 
education programs that incorporate mass media intervention as a way 
of changing perceived social norms are more effective at reducing adoles- 
cent smoking than health education programs without media (Elster and 
Kuznets, 1994). In addition to their effect on perceived social norms, the 
media must be recognized as an important competing influence on ado- 
lescents’ internalization of the prosocial norms advocated by schools, 
families, and other traditional socializing institutions, such as faith-based 
institutions. 

Research on community programs also indicates that social norms 
are critical. On the positive side, Cook et ah (1993) reported that ac- 
quiring conventionally positive social norms did a better job of explain- 
ing the results of one prevention program than did social skills training. 
Smoking prevention programs that taught both how to resist peer pres- 
sure and support heath behavior changes are among the more effective 
youth health promotion programs (Sallis, 1993). Efforts at teaching so- 
cial norms against early steady dating and against sexual intercourse were 
also related to reductions in dating and pregnancy in three studies of the 
Girls, Inc., Preventing Adolescent Pregnancy Project (Nicholson and 
Postrado, 1992; Postrado et ah, 1997). A more rigorous evaluation of 
these programs in now under way. 

Promotion of certain types of positive social norms may be particu- 
larly strong in faith-based youth settings: religiosity is positively associ- 
ated with what developmental psychologists call prosocial values and 
behavior (see Eisenberg and Fabes, 1998) and negatively related to sub- 
stance abuse, premature sexual involvement, and delinquency (Benson et 
ah, 1997; Catalano et ah, 1999; Elder and Conger, 2000; Jessor et ah, 
1991; Werner and Smith, 1992). 

On the more controversial side, two in-depth observational studies 
have documented the reinforcement and reproduction of gender stereo- 
types in sports and extracurricular activities; for example, both studies 
found that sports promoted masculine aggressive and competitive norms 
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(Eder and Parker, 1987; Fine, 1987). And on the more negative side, 
participation in sports is associated with lower rates of altruism (Kleiber 
and Roberts, 1981). 

Finally, Dishion and his colleagues have shown that adolescents who 
are grouped together for an intervention with a large proportion of peers 
demonstrating problem behaviors often show increases in a variety of 
problem behaviors as a consequence of participating in the intervention 
(Dishion et ah, 1999a). This negative impact has been explained by 
pointing to the impact of the antisocial norms created by the large num- 
ber of youth heavily involved in problem behaviors. The bottom line is 
that, whether they are intentionally cultivated or not, community pro- 
grams have an internal culture of social norms that shapes youths’ per- 
ception of appropriate behavior for good or ill, depending on the social 
norms that emerge. Program personnel need to carefully consider exactly 
what social norms are being created and reinforced in their programs. 

As with all our features, it is critical to consider how the influence of 
social norms varies across cultural groups and individuals. Cultures and 
subcultures, of course, are an important source of social norms, and 
groups differ in the norms they hold most highly. Many cultures share 
fundamental moral values (for example, against murder and harm to 
others), but they vary in norms related to conventions, and these norms 
often carry moral weight during adolescence, when group belonging is so 
important (Turiel, 1983). Leaders of community programs need to be 
sensitive to how congruent the norms of their organization are with 
norms of the culture of their participants. 

Such cultural variations also make it difficult to identify a single set 
of positive social norms that should be supported in all community pro- 
grams for youth. Communities will differ in the norms they hold most 
dear. We include this feature of settings not so much to outline a par- 
ticular set of social norms as universally critical but more to highlight the 
significance of social norms for development in settings such as commu- 
nity programs for youth. 

Before leaving this section, it is important to note two additional 
important considerations about social norms. First, research suggests 
that the strength of different sources of influence may vary across cul- 
tural groups. Landrine and colleagues (1994) found that peers had a 
stronger influence on smoking for white youth than for Hispanic and 
Asian youth, and peers had no influence on smoking among black youth. 

Second, individual differences are also important. Susceptibility to 
peer influence is a critical mediator of the effect of peer norms on behav- 
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ior (Fuligni and Eccles, 1993), and susceptibility to peer pressure is higher 
among younger adolescents and those with less confidence in their social 
skills (Brown, 1990). People with low self-esteem, low self-confidence, 
low autonomy, and an external locus of control are more likely to be 
influenced by social norms (Cook et al., 1993). Susceptibility to peer 
influence also varies across youth from different family structures and 
parenting styles (Brown, 1990). Children who are more integrated into 
cohesive families or peer groups are more resistant to the influence of 
media (Gerbner et ah, 1994) and are likely to be more resistant to nega- 
tive peer influences as well. 

How do norms influence development? Both sociologists and psy- 
chologists describe a process in which observation of, and participation 
in, behavior becomes internalized to form values, morals, and “cognitive 
schemata” (Berger and Luckmann, 1966; Coleman, 1990; Huesmann 
and Guerra, 1997). This process begins earlier in life, through interac- 
tions with family and peers. Huesmann and Guerra (1997) concluded 
that normative beliefs about aggression get formed in childhood and 
become more difficult to change as children move into adolescence. Once 
internalized, Guerra et ah (1994) suggested, behavioral patterns become 
automatic (i.e., they are followed without reflection or evaluation). The 
experience of positive social norms is therefore important to the develop- 
ment of good habits in all areas of positive development. We think norms 
are particularly important to social, psychological, and emotional devel- 
opment because they shape morals, present ways of relating to others, 
and provide templates of self-control. 



Support for Efficacy and Mattering 

A critical contribution of psychological theories, such as those of 
Piaget and Erikson, is the recognition that positive development is not 
something adults do to young people, but rather something that young 
people do for themselves with a lot of help from parents and others. 
They are the agents of their own development. To foster development, 
then, it follows that settings need to be youth centered, providing youth — 
both individually and in groups — the opportunity to be efficacious and 
to make a difference in their social worlds — we refer to this opportunity 
as “mattering.” We combine under this feature multiple elements drawn 
from other researchers and practitioners: the importance of actually hav- 
ing the opportunity to do things that make a real difference in one’s 
community, the idea of empowerment, and support for increasingly au- 
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tonomous self-regulation that is appropriate to the maturing individuals’ 
developmental level and cultural background. After some discussion, we 
added the opportunity to experience meaningful challenge to this fea- 
ture, because success at such experiences is critical to developing a sense 
of personal efficacy (Bandura, 1994). Efficacy results not just from turn- 
ing power over to youth, but from seeing that they are challenged to 
stretch themselves in demanding, novel, and creative activities (Bandura, 
1994; Gambone and Arbreton, 1997). It must be emphasized that “op- 
portunity” is not experienced as “challenge” unless youth identify with 
it: adolescents need to be engaged by opportunities for efficacy and mat- 
tering that are meaningful to them. 

Evidence for the importance of this feature comes from research on 
multiple settings. Research on families shows that when parents support 
their adolescent children’s autonomy by allowing them to express their 
point of view and to have serious input into family decisions, they de- 
velop more positive motivation, engage in more identity exploration, and 
show higher ego development (Deci and Ryan, 1985; Grolnick and Ryan, 
1987, 1989; Grotevant, 1998; Hauser et al., 1991; Steinberg, 2000). 
Conversely, overcontrolling and restrictive parenting are associated with 
constricted development of ego functions and greater likelihood of inter- 
nalizing problems (Baumrind, 1971; Epstein and McPartland, 1979; 
Steinberg, 2000). Challenge and the demandingness of parents are a part 
of this. There is a well-established link between the educational expecta- 
tions of parents and a child’s self-esteem, locus of control, sense of per- 
sonal efficacy, academic motivation and performance (Eccles et al., 1992; 
Marjoribanks, 1979), and some protection from emotional distress (Blum 
and Rinehart, 1997). Parents’ encouragement and acceptance of their 
adolescent children’s desire to take some risks, learn new skills, and take 
responsibility, combined with consistent parental support, careful moni- 
toring, and good communication, are predictive of growing competence 
and motivation in adolescents (Csikszentmihalyi and Rathunde, 1998). 

Support for efficacy and mastery is also important in school and 
adolescent work settings. Mastery-oriented classrooms that focus on 
self-improvement rather than social comparison foster higher motivation 
and perceptions of oneself as more capable; in contrast, overly control- 
ling classrooms that do not provide opportunities for autonomy under- 
mine motivation, self-concepts, expectations, and direction and induce 
learned helplessness in response to difficult tasks (National Research 
Council, 1999; Eccles et al., 1998; Jackson and Davis, 2000; Maehr and 
Midgley, 1996; Newmann and Associates, 1966; Eccles et al., 1996b; 
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Wehlage et al., 1996; Wiggins and McTighe, 1998). A poignant ex- 
ample is the finding that low teacher expectations for academic perfor- 
mance of ethnic minority children conveyed in teacher-student interac- 
tions in elementary schools lead to alienation from learning experiences 
and underachievement (Jackson and Davis, 2000; Fisher et al., 1998; 
Romo and Falbo, 1996). In the workplace, adolescents in jobs that use 
their skills show more positive outcomes than those in unchallenging 
jobs (Mortimer et al., 1999). 

Although less likely to involve longitudinal designs, research with 
community programs suggests similar relations. Participation in deci- 
sion making is correlated with positive developmental outcomes, such as 
a sense of sharing and respect for others (Dryfoos, 1990; Gambone and 
Arbreton, 1997; Lipsitz, 1980; Merry, 2000; McLaughlin, 2000). In 
school settings, the opportunity to participate in making and enforcing 
school rules leads to an increase in students’ willingness to follow the 
rules and in their attachment to the school (Darling-Hammond, 1997). 
Adolescents in youth-centered activities develop new cognitive skills that 
increase their confidence and ability to make positive decisions (Heath, 
1999; McLaughlin et al., 1994). For example, a group of adolescents 
who planned alcohol-free activities showed less subsequent alcohol use 
(Scales and Leffert, 1999). Similarly, the experience of challenging 
activities predicts greater likelihood of participating in a community pro- 
gram for youth and less high-risk behavior (Dryfoos, 1991; Gambone 
and Arbreton, 1997; Merry, 2000). A description of what it means for a 
community program to be youth centered is provided in Chapter 5 (see 
also McLaughlin, 2000). Finally, both longitudinal survey-type studies 
and experimentally evaluated small-scale intervention studies have shown 
the positive consequences of participating in a wide variety of well- 
designed community service activities (Dryfoos, 1991; Merry, 2000; 
Lipsitz, 1980; Scales, 1999; Youniss, 1997; Yates and Youniss, 1999). 

The notion that this feature must fit with the adolescents being served 
is particularly important here. For a setting to support efficacy and the 
sense that one is making a useful contribution, it must be developmental^ 
and culturally appropriate. Most young adolescents are not cognitively 
or emotionally ready to take full responsibility for a community pro- 
gram. Empowerment involves gradually increasing freedoms and respon- 
sibilities as young people mature (McLaughlin, 2000; Scales and Leffert, 
1999). Culturally, a setting must be attuned to the level and modes of 
efficacy and mattering that are normative in the adolescents’ larger cul- 
tural system. As we noted earlier, people differ in the amount of value 
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they place on autonomy. Many American Indian tribes, such as the 
Navajo, place high value on letting children make their own decisions 
(LaFromboise and Graff Low, 1998), whereas other ethnic minority 
groups in this country do not (Fisher et al., 1998). People also differ in 
the degree to which they conceptualize efficacy as individualized action 
rather than a collective process. Programs need to take these character- 
istics into account. 

The challenges must also fit with the adolescents’ level of compe- 
tence. Research in classrooms shows that students are more motivated 
to learn when material is appropriate for their current levels of compe- 
tence (Maehr and Midgley, 1996). Challenges that are too high or two 
low for a given person will undermine sustained engagement 
(Csikszentmihalyi, 1990). Vygotsky, too, theorized that growth is most 
likely when people are challenged at a level somewhat above but not too 
far beyond their skills. In community programs, it appears that the avail- 
ability of a variety of novel and interesting activities increases youth’s 
active participation (Gambone and Arbreton, 1997; McLaughlin, 2000). 
Culture is important here, too, because it determines what will make for 
a personally meaningful challenge. 

Like structure, support for efficacy and mattering are necessary fea- 
tures for development in any setting. If adolescents do not experience 
personal engagement and a sense of mattering, they are not likely to 
grow personally. These features, then, are prerequisite to all types of 
development described in Chapter 2, but they have a particular relevance 
to psychological, emotional, and social development. Theory suggests 
that it is through acting, taking on challenges,' and making meaningful 
contributions that a person’s sense of self and identity develops. 

Opportunities for Skill Building 

Good settings provide opportunities to acquire knowledge and learn 
both new skills and new habits of mind. We include here cognitive, 
physical, psychological, social, and cultural skills. Of course, some com- 
munity programs specialize in promoting the development of specific 
skills, such as athletic or artistic abilities. But good programs encourage 
learning in other areas as well. They can encourage the development of 
good habits and a wide range of competences and life skills, from media 
literacy to acquiring job skills through the use of an “embedded curricu- 
lum” and a curriculum that systematically cycles through planning, prac- 
tice, and performance (McLaughlin, 2000). The specific skills promoted 
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should vary across cultural groups, depending on the outcomes different 
groups see as most important. For individuals who are or who will be 
participants in multiple cultures — as is increasingly the case across 
America — skill training should involve learning how to function in sev- 
eral different cultural systems (LaFromboise et al., 1993; Phelan and 
Davidson, 1993). Involvement in activities with embedded curricula 
leads to gains in both social and cultural capital (Clark, 1988; 
McLaughlin, 2000). 

Research on how curricula function in community programs is found 
in diffuse literatures, employs diverse paradigms, and is generally under- 
developed. Some studies show that sports programs develop athletic 
skills and music programs develop music skills. More important is newer 
research showing that programs that teach basic life skills, such as cop- 
ing, assertiveness, and problem solving, predict improved emotional well- 
being, better school performance, and reduced risk behaviors (Compas, 
1993; LaFromboise and Howard-Pitney, 1994). More research is needed 
on how these opportunities to learn basic life skills can be effectively 
woven into activities of community programs. 

On a more positive note, studies of schools and nonschool commu- 
nity-based programs show consistent evidence of the importance of learn- 
ing new cognitive and life skills (Coleman et al., 1966; Clark, 1983, 
1988; Comer, 1980, 1988; Murnane and Levy, 1996, see also Chapter 2 
for evidence of the importance of good academic outcomes). McLaughlin 
(2000) concluded that having an intentional learning environment was 
one of the critical characteristics of the successful community-based pro- 
grams she and her colleagues studied. Similarly, Merry (2000), in her 
Chapin Hall report, concluded that educational supports and career ex- 
ploration programs are characteristics of community-based programs 
with positive outcomes for their participants. A similar conclusion was 
reached 10 years ago by Dryfoos (1990) and more recently by the 
Carnegie Corporation in its report A Matter of Time. Schinke and his 
colleagues provided additional evidence of the positive impact of well- 
designed educational enhancement programs in Boys and Girls Clubs in 
a public housing development on both school outcomes and reductions 
in drug-related activities (Schinke et al., 1993). The reports by Dryfoos 
and Merry also stressed the positive linkage between programs designed 
to teach adolescents peer-pressure resistance skills, such as those taught 
in the Girls, Inc. Will Power Program. We discuss some of these pro- 
grams in more detail in Chapter 5. 

Abundant research now exists for educational settings on how to 
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best teach new skills, new knowledge, new understandings, and new 
habits of mind (see, for example, Ames, 1992; Bransford et al., 1999; 
Darling-Hammond, 1997; Eccles et al., 1998; Jackson and Davis, 2000; 
Maclver et al., 1995; Meece, 1994; Newmann and Associates, 1996; 
Pintrich and Schunk, 1996; Wehlage et al., 1996; Wiggins and McTighe, 
1998; Zemelman et al., 1998). A full review is beyond the scope of this 
report, but there is growing consensus that the following teaching strat- 
egies and techniques are important: 

Authentic Instruction 

° Active construction of knowledge in which students are asked to 
construct or produce knowledge rather than just reproducing or 
repeating facts and views expressed by teachers and textbooks; 

° Disciplined inquiry in which students are encouraged to engage in 
deep cognitive work “that requires them to rely on a field of 
knowledge, search for understanding, and communicate in ‘elabo- 
rated forms’ their ideas and findings” (Jackson and Davis, 2000: 
69). This characteristic also includes active instruction in the 
meta-cognitive skills needed to monitor one’s own learning and 
progress; 

° Relevance of material being studied to the student and his or her 
community culture. The work that students are doing in school 
should be valued and recognized as important beyond the school 
and classroom; 

° Regular feedback on progress so that students understand what 
they know and what they still need to learn and master. The 
feedback needs to focus on progress and on new learning needs, 
rather than one’s current performance level compared with others 
in the class or learning group; 

° Abundant opportunities to rethink one’s work and understanding; 

° Ongoing reflective practices by teachers and instructors that in- 
volve a careful examination of “what kinds of knowledge, skills, 
habits of mind, and attitudes are prerequisites for successful final 
performance, then deciding what instructional activities will give 
all students the chance to be successful, while engaging their inter- 
est and allowing for exploration” (Wiggins and McTighe, 1998: 



° Differentiated instruction that recognizes the individual differ- 
ences in levels of current knowledge, interests, and learning styles 
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and provides multiple ways of learning new material and demon- 
strating that learning; and 

° Cooperative and highly interactive learning activities that allow 
students to work with and tutor each other and allow instructors 
to work with them in designing learning activities that provide the 
kinds of experiences listed above. 

Practices that support positive motivation 

° Grading practices that stress improvement rather than social com- 
parison; 

° Teaching practices that stress mastery and improvement rather 
than current levels of knowledge; 

° Practices that reflect high teacher expectations for all students’ 
performance; 

° Practices that make sure all students are expected to participate 
fully in the learning activities of the classroom; and 

° Practices that involve hands-on activities (like laboratory exer- 
cises and field-based data collection efforts). 

Perhaps the most striking research findings concern ways in which 
athletic community programs can fall short in establishing skills and 
habits that would seem to follow naturally from physical activity. Find- 
ings regarding the association of participating in organized sports as a 
youth and physical activity as an adult are conflicting. A number of 
reports show an association; others find no significant relations (Elster 
and Kuznets, 1994). On one hand, many sports teams do not prepare 
adolescence for life-long physical activity and can lead to excessive exer- 
cise and eating habits or the use of steroids (Sallis, 1993). On the other 
hand, adolescent physical activity is associated with higher short-term 
levels of fitness, greater resistance to cigarette and alcohol use, and pos- 
sibly enhanced academics and cognition (Institute of Medicine, 1997a; 
Seefeldt et al., 1995). In a national survey, female athletes were less 
likely to get pregnant than nonathletes, irrespective of ethnicity. They 
were more likely to be virgins, to have later onset of intercourse, to have 
sex less often and with fewer partners, and to use condoms (Sabo et al., 
1998). In other studies, participation in sports in high school was linked 
to better educational and occupational outcomes in early adulthood 
(Barber et al., in press; Eccles and Barber, 1999). Finally, one of the 
coaches discussed by McLaughlin (2000) integrated mathematics, eco- 
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nomics, and history into his sports program by having the participants 
do a series of intellectual activities directly related to the sport. The basic 
point, however, is that participating in an activity does not mean that 
adolescents are acquiring the habits of and dispositions for the activity in 
the future. Programs need to be explicitly designed to teach these habits 
as well as other critical life skills. 



Integration of Family, School, and Community Efforts 

In Bronfenbrenner’s and various other models, adolescent develop- 
ment is facilitated when there is meaningful communication and synergy 
among the different settings of adolescents’ lives and among the adults 
who oversee these settings. Optimal conditions for development exist 
when there is cohesion and information flow between systems — for ex- 
ample, when parents know what is going on at school and with peers 
and when principals, community leaders, and parents are in touch and 
have a shared perception of community standards for behavior. This 
communication facilitates acquiring social capital, and it increases the 
likelihood of adequate structure in the setting. It also adds to the fund of 
developmental resources that adolescents can draw on. Communication 
and integration also facilitate the processes of management described by 
the family management perspective (Furstenburg et al., 1999). When it 
is lacking, when different parts of adolescents’ worlds are out of touch 
and on different wavelengths, there is increased likelihood that develop- 
mental opportunities will be missed, that adolescents will be confused 
about adult expectations, and that deviant behavior and values will take 
root. 

Research substantiates the importance of this integration between 
the settings and institutions in adolescents’ lives. This is evident, first, in 
the links between home and school. When young adolescents receive 
reassurance, assistance, and support from their parents, they are more 
likely to believe that their in-school effort will pay off (Eccles et al., 1992; 
Feagans and Bartsch, 1993; Marjoribanks, 1979). Parent involvement 
and interest in children’s school activities are related to better school 
motivation and performance as well as more successful school transi- 
tions (Baker and Stevenson, 1986; Comer, 1980, 1988; Eccles and 
Harold, 1996; Epstein and Dauber, 1991; Henderson and Berla, 1994; 
Booth and Dunn, 1996; Jackson and Davis, 2000; Romo and Falbo, 
1996; Stevenson and Baker, 1987). We also see it in the links between 
family and community. Rural adolescents whose parents were actively 



128 



Features of Positive Developmental Settings 



involved in the community showed higher academic and peer success 
(Elder and Conger, 2000; Grotevant, 1998). Darling and Steinberg 
(1997) found similar results in a study of six communities in the San 
Francisco Bay area: they found that positive development was clearer in 
communities that had strong shared prosocial norms. 

We also see it in the links between schools and communities. School 
programs that included one or more community program components 
have longer-lasting and larger effects on adolescent drug use and smok- 
ing than school programs alone (Dryfoos, 2000). Health messages that 
are reinforced through multiple settings, such as school, home, and health 
care facility, have greater effects than those delivered by only one source 
(Elster and Kuznets, 1994). 

The opposite side of the coin is research showing that lack of inte- 
gration among these settings is associated with more problem behavior 
in adolescents. Lack of communication and conflict between parent and 
school values are related to lower school achievement (Comer, 1988; 
Fisher et al., 1998; Peshkin, 1997; Romo and Falbo, 1996). Conflict 
between family values and community values is related to more adoles- 
cent problem behavior (Schwartz, 1987; Romo and Falbo, 1996). Part 
of the reason is that it is harder for parents to play a management role 
when they are out of touch with the other parts of adolescents’ lives. 
Among a Southeast Asian immigrant population in Minnesota, Detzner 
found that parents had difficulty asserting themselves with their adoles- 
cents in a social setting they did not understand. This appeared to be 
related to increases in delinquency, juvenile arrests, and gang activity 
among adolescents in the community (Grotevant, 1998; Hughes and 
Chen, 1999). 

The potential for communication and integration varies widely 
across communities. Those that are small, are culturally homogeneous, 
and have more resources are likely to find it easier to maintain integra- 
tion. It is a common observation that a sense of community is harder to 
achieve given the fast-paced, anonymous, culturally diverse, urban life- 
style that has taken over much of the United States. However, pessimism 
and passivity are not warranted. There are numerous examples of con- 
temporary communities that have come together to establish communi- 
cation, bridge differences, and find common ground for facilitating ado- 
lescent development (Benson, 1997; Damon, 1997; Dryfoos, 2000; 
Merry, 2000). Even when there are intransigent problems, parents can 
make a difference. Parents of middle-class black children often engage in 
deliberate strategies of “racial socialization” to help protect their chil- 
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dren from the effects of racism (Stevenson, 1995). Parents with more 
limited resources often face fewer choices and more constraints in man- 
aging their children’s experiences, yet Jarrett’s (1997) research shows 
that effective parents in disadvantaged neighborhoods are active in moni- 
toring their children, seeking resources, and developing in-home learning 
strategies (see Furstenburg et al., 1999). 

There has been limited conceptual work and systematic research that 
examines integration across community programs; however, given past 
research in other settings, there is every reason to believe that community 
programs will be more effective when they coordinate their activities 
with parents, schools, and communities. Exciting efforts in this direction 
are emerging and are discussed in more detail in Chapters 5 and 6. 



ESSENTIAL INGREDIENTS OF GOOD PROGRAMS 

In concluding this chapter, we consider what developmental science 
suggests about the essential components of community programs in terms 
of three points of view: the program perspective, the individual partici- 
pant perspective, and the perspective of the community in which pro- 
grams reside. 



Perspective of the Program 

The evidence, although incomplete, suggests that the more of the 
eight positive features described in this chapter that a community pro- 
gram has, the greater the contribution it will make to the positive devel- 
opment of youth (Dryfoos, 1991, 2001; Merry, 2000; McLaughlin, 
2000). Although each feature is related to positive processes of develop- 
ment, they also work together in important ways. For example, adoles- 
cents’ experience of attachment to adult leaders is likely to magnify the 
influence of the social norms and organizational culture of the program. 
Likewise, not experiencing one of these features or experiencing the nega- 
tive aspects of one of the features is likely to undermine the effects of 
other features. Programs cannot focus only on promoting the positive; 
they need to be attuned to limiting the negative. Empowering young 
people is not enough to keep them from abusing drugs; one needs to 
communicate the message that drugs are harmful and actively cultivate 
social norms that discourage their use. 

Programs, of course, differ in their objectives. Some may choose to 
give more emphasis to particular features and the processes of develop- 
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ment that follow from them. Nonetheless, we consider all of the features 
to be highly desirable. Adequate structure and safety, for example, are 
necessary to any community programs for youth. Little development 
can occur in an environment that is chaotic or where adolescents fear 
harm. Positive social norms and messages about relations between di- 
verse groups (belonging) are going to exist in all youth environments; the 
question is whether they will promote positive behavior and group rela- 
tionships. Supportive relationships with adults and integration of the 
program with other institutions in the community are highly desirable, 
but they may not happen in all instances. Sometimes youth persevere 
even if they do not like the leader, and sometimes organizations cannot 
work well with each other. Likewise, the specific skills that youth learn 
will vary across community programs: sports programs focus on physi- 
cal skills, chess clubs on intellectual skills. However all community pro- 
grams need to be attuned to the social, psychological, and emotional 
skills they are imparting. 

We are not suggesting here that all youth programs and youth-serv- 
ing organizations must have a wide variety of different activities. A pro- 
gram or organization can be quite focused on one activity, such as sports 
or tutoring or music instruction, and still have all eight of the features 
discussed in this chapter. Both McLaughlin (2000) and Merry (2000) 
provide many examples of both comprehensive and focused programs 
that provide structure, close relationships with caring adults, opportuni- 
ties to learn new skills, opportunities to develop feelings of efficacy and 
mattering, opportunities to belong, exposure to positive social norms, 
and strong connections to either school or family. 

A point we have stressed throughout is that these features also need 
to fit well with the individual participants’ needs and characteristics. 
They are features of a youth’s interaction with the setting; they do not 
exist independently of the individual. Two adolescents walking in the 
door at the same time may have very different experiences of the same 
community program. One may find it friendly, whereas the other finds 
it hostile. One may find it empowering, whereas the other finds it sti- 
fling. Within their capability, community programs need to be sensitive 
and adapt according to gender, age, developmental readiness, sexual ori- 
entation, and culture, so they can provide these eight features for as many 
youth as possible. Research in nontraditional classrooms shows that 
students are more motivated, develop more autonomy, have better self- 
concepts, and capitalize better on their strength and preferences when 
they can choose among activities according to their ability level (see 
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Eccles et al., 1998, for a review). Likewise, a mismatch between an 
adolescent’s needs and the characteristics of the school may be causally 
related to reduced self-esteem and academic achievement (see Eccles et 
al., 1998; Feagans and Bartsch, 1993). Any program that is not sensitive 
to the participants’ culture is not likely to succeed (Ford and Harris, 
1996; LaFromboise and Howard-Pitney, 1994; Romo and Falbo, 1996; 
Goldenberg and Gallimore, 1995). 



Individual Adolescent’s Perspective 

If our ultimate goal is fostering positive development in youth, then 
it is critical to think about how community programs fit into the rest of 
the adolescents’ lives, into the vulnerabilities and developmental assets 
that exist across all the settings in which they spend their days. Research 
suggests that adolescents with more developmental assets have greater 
positive development (Benson, 1997). This finding suggests that the more 
settings adolescents experience that have more of the eight features, the 
better off they will be. Redundancy of features is good; for example, 
adolescents who experience two settings with similar positive social 
norms are more likely to internalize the norms than someone who expe- 
riences conflicting norms across settings. In addition, experiencing a 
positive feature in one setting may be able to compensate for its absence 
in other settings. For example, research shows that having one warm 
and supportive relationship with a nonfamily member, like a leader or a 
coach, can make a big difference in compensating for the absence of such 
a relationship at home (Werner and Smith, 1982). Finally, adolescents 
who do not experience these features on a regular basis are likely to have 
more developmental problems than adolescents who do experience these 
features in some settings. The adolescent who does not experience any 
of the eight features anywhere in his or her daily life is at great risk for 
developmental delays or for heading down a negative developmental 
pathway. 

The reality is that there are many gaps in adolescents’ experience of 
these eight features. Many settings fall short of providing all of them. 
For example, schools often provide adolescents the experience of chal- 
lenge but without engaged motivation (Larson, 2000). Families often 
provide warmth without challenge (Csikszentmihalyi and Rathunde, 
1998). And some adolescents do not experience one or more of these 
features anywhere. Youth in disadvantaged neighborhoods may experi- 
ence chaotic environments at home, at school, and on the streets. Across 
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social classes, there are youth who do not have any adult with whom 
they experience a caring relationship. The growing obesity of the popu- 
lation speaks to the lack of opportunity for physical development. 

Community programs are important because they can provide fea- 
tures that are missing or in short supply in other settings. They can fill 
gaps. Across adolescents’ daily settings, community programs are unique 
in consistently providing the experience of engaging challenges (Larson, 
2000). They often entail connection to a group that can provide oppor- 
tunities to address underlying issues of ethnic identity and intergroup 
relationships (National Research Council and Institute of Medicine, 
2000b). They can provide unique opportunities for youth to be involved 
in volunteer service activities that cultivate and internalize prosocial 
norms and values. They can provide opportunities for physical develop- 
ment, artistic development, and socioemotional development that are 
missing in other parts of adolescents’ lives. 

Advocates of community programs have promoted this abundance 
of developmental opportunities for more than 100 years. What struck us 
as researchers was the paucity of empirical evidence on how often and 
when adolescents actually experience conditions for positive develop- 
ment in community programs, much less across the whole array of set- 
tings in which they participate over time. There is a critical need for 
survey data that examine how often each of the eight features is experi- 
enced, which types of community programs most often provide these 
experiences, and how these experiences differ by age, gender, socioeco- 
nomic status, ethnicity, sexual orientation, and community. Research is 
needed on the role community programs play in filling gaps in adoles- 
cents’ total array of experience and what gaps remain, as well as on 
specific groups of adolescents who are consistently underserved by the 
options that exist. 



It is unrealistic and unwise to expect that every community program 
will be able to provide all eight features to all youth. To begin with, 
many adolescents may simply not be interested in the activities offered 
by specific programs. Furthermore, no single community program can 
be all things to all people. With limited resources, they may not be able 
to provide programming across all ages and developmental levels. Spe- 
cific programs may have particular strengths that lead them to focus on 
more limited experiences. Intervention provided at one stage of life 
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should not be assumed to work at another (Compas, 1993). Communi- 
ties need to think about the full set of programs they provide and how 
adequately they supply opportunities for all their youth. Communities 
need a menu or portfolio of programs that allows adolescents and their 
families to select out the experiences most needed or desired. 

The importance of the community as a unit of analysis for youth 
development is becoming increasingly popular. For example, this per- 
spective is being encouraged by the research of the Search Institute in 
Minneapolis, which shows, first, that communities differ substantially in 
the number of psychological and social supports they have for youth 
and, second, that youth are healthier in communities that have more of 
these supports. This relation goes beyond the predictive power of the 
number of assets experienced by an individual youth: when a community 
is rich in supports, even at-risk youth seem to be doing better than in 
communities without such supports and opportunities (Benson, 1997; 
Blyth and Leffert, 1995). This perspective is also central to the work by 
Hawkins and Catalano (Hawkins, Catalano, and Associates, 1992; 
Development Research and Programs, Inc., 2000) on Communities that 
Care and by Public/Private Ventures on community-wide initiatives for 
youth (Gambone, 1997). Both of these programs are discussed in more 
detail in Chapter 5. Finally, the community perspective is gaining promi- 
nence in prevention work, in which more and more efforts are being 
made to design and evaluate community-wide interventions (see work by 
Biglan and colleagues as one such example [Biglan et al., 2000]). 

What has not been researched systematically is how community pro- 
grams fit into this picture of community supports and whether they can 
actually cause changes in the prevalence of both positive and risky youth 
outcomes. The associations undercovered by Benson and his colleagues 
at the Search Institute could result from characteristics of the communi- 
ties that were unmeasured and influenced both the communities’ ability 
to generate and support multiple supports for their youth and the resil- 
ience of the youth themselves. Community-wide experiments are just 
beginning to be reported. For the most part, these experiments do not 
vary the number of supports but rather the commitment of the commu- 
nity to change and the provision of financial and person-power resources 
for a change initiative. In addition, there is not yet a model for how a 
community can assess whether its set of community programs provides 
good coverage for all youth, or whether there are major gaps. In general, 
we know that the availability of youth development focused institutions 
and programs vary with neighborhood socioeconomic status. Fewer 
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community programs are available in poorer neighborhoods (Halpern- 
Fisher et ah, 1997). Access is also lower for minority youth and in rural 
areas (Carnegie Corporation of New York, 1992). Clearly more research 
is needed that takes the community as its focus. 

There are lessons here for communities as well. They should not just 
sit back and assume that their youth are being taken care of. They need 
to actively assess whether there are opportunities for all youth and 
whether their range of programs provides good coverage of the eight 
features. This means they need to have someone or some agency that 
attends to the community menu of programs, who has responsibility for 
oversight and coordination, and perhaps even helps youth get connected 
to community programs that suit their needs and abilities. 

SUMMARY 

Research demonstrates that certain features of the settings that ado- 
lescents experiences help facilitate positive development. Research on 
the settings of the family, schools, and the community supports the con- 
clusion that daily settings are more likely to promote positive develop- 
mental assets if they provide: 

° Structure and limits that are developmentally appropriate and that 
recognize adolescents’ increasing social maturity and expertise; 

0 Physical and psychological safety and security; 

0 Opportunities to experience supportive relationships and to have 
good emotional and moral support; 

0 Opportunities to feel a sense of belonging; 

0 Opportunities to be exposed to positive morals, values, and posi- 
tive social norms; 

0 Opportunities to be efficacious, to do things that make a real dif- 
ference and to play an active role in the organizations themselves; 

0 Opportunities for skill building, including learning how to form 
close, durable human relations with peers that support and rein- 
force healthy behaviors, as well as to acquire the skills necessary 
for school success and successful transition into adulthood; and 

0 Strong links between families, schools, and broader community 
resources. 

Although there is limited research that specifies what community 
programs for youth can do to facilitate positive adolescent development, 
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the list identified in this chapter is a step toward formulating a frame- 
work for features of community programs that support the acquisition 
of assets of personal and social development and, in turn, support posi- 
tive adolescent development. 

As was summarized in Chapter 3, there is evidence that adolescents 
with more personal and social assets have greater positive development. 
Since program features typically work together in synergistic ways, pro- 
grams with more features are likely to provide better supports for young 
people’s positive development. 

We need to reemphasize the limits of the research used in this chap- 
ter. First, the chapter has drawn primarily on studies of such settings as 
families and schools and then extrapolated the findings to community 
programs. Research focusing directly on these features in community 
program settings would increase our understanding of how community 
programs for youth could incorporate these features into program design 
and implementation. 

Second, we have stressed that our configuration of these features 
into a list of eight is provisional. The boundaries between features are 
indistinct, and the titles given to them tentative. It is unlikely that an- 
other group of scholars would come up with the exact same list, al- 
though the underlying content is likely to be very similar. Research is 
needed that further sharpens the conceptualization of these features and 
does so in the context of community programs. It is also possible that 
new research will find features that we have not included. 

Finally, there is evidence that adolescents in communities that are 
rich in developmental opportunities for them experience reduced risk 
and show higher rates of positive development. This suggests that com- 
munities need a menu or portfolio of programs that provides a fit for 
every adolescent. Communities need models for how they can assess 
whether its set of community programs provides good coverage for all 
youth or whether there are major gaps in who they are serving. Research 
focusing directly on these features in community programs for youth is 
essential — research that sharpens the conceptualization of these features 
in community program settings. 
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As summarized in the Part I, evidence suggests that the more positive 
features a setting has, the greater contribution it will make to young 
people's positive development. The list of features of positive develop- 
mental settings we have presented was generated primarily from evidence 
about families, schools, and neighborhoods. Given that the focus of this 
report is on community programs for youth, we turn now to a review of 
the ways in which these programs incorporate features of positive devel- 
opmental settings and provide opportunities for young people to acquire 
personal and social assets and promote their positive development. 

What can community programs for youth do to give each person 
who walks in the door the best chance possible of acquiring the assets 
described in Part I of this report? How do we make sure that programs 
engage all youth and support their development? 

In this part we provide examples of community programs that pro- 
mote adolescent development. There is great diversity in the structure, 
focus, and size of these programs. Funding mechanisms, staff training, 
and management styles also vary. Programs differ in their objectives and 
the emphasis they place on particular program features. But all pro- 
grams can strive toward incorporating developmental opportunities while 
working to meet the needs of individual participants. 

This part of the report reviews studies and evaluations that detail 
how programs incorporate features of positive developmental settings 
and their impact on the outcomes for adolescents. Chapter 5 considers 
findings from a number of nonexperimental studies using various meth- 
ods to collect information; Chapter 6 looks at findings from a set of 
comprehensive experimental evaluations. 




CHAPTER 5 



The Landscape of Community 
Programs for Youth 



A group of 20 young people meets twice a week for three 
hours after school with their school dance teacher and a 
professional dancer from the city's local dance troupe . 
They spend one hour doing their homework and receiving 
tutoring assistance from the staff ’ Then they participate in 
an hour of rigorous stretching and calisthenics . Exhausted 
but exhilarated , they spend the remainder of their after- 
noon rehearsing for their upcoming dance performance at 
a school talent show. 

A half-dozen teenagers meet at their local community 
centers with adult city council members to share the results 
of a survey they conducted to help the city council under- 
stand adolescent needs and how to serve young people 
more effectively . They leave the meeting with plans to meet 
again the following week with two city council members 
to plan a community service event for young people and 
their families. 

Hundreds of young people in uniforms fan out to vari- 
ous neighborhoods across the city in one of the country's 
largest urban areas. Working in teams , they participate in 
various community service tasks , such as tutoring children , 
landscaping , and cleaning a park. Between community 
service projects , these youth receive tutoring and assistance 
in preparing for a high school equivalency exam. 
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These examples of community programs for youth represent just a 
few of the many diverse programs operating throughout the United 
States. There are various efforts at both the individual organization level 
and the broader community level to promote adolescent development 
through community programs. While many youth organizations, foun- 
dations, and citywide initiatives support youth development concepts and 
practices, there is little agreement on what specifically constitutes a youth 
development program and little systematic information on the breadth 
and diversity of efforts to provide these kinds of opportunities. 

Community programs for youth vary in many significant ways. A 
program represents a number of elements and decisions that together 
constitute a program setting. Some of these dimensions represent choices 
made, such as the program focus, curriculum, and membership; others 
are not choices but the consequences of structural arrangements, organi- 
zational affiliations, local community issues, geographic location, fund- 
ing, and political climate. 

This chapter creates a bridge between the framework for adolescent 
development and program design and implementation by providing ex- 
amples of ways in which community programs for youth incorporate the 
features of positive developmental settings described in Chapter 4. Com- 
mittee members observed a variety of community programs for youth 
and reviewed literature describing these programs. We also drew heavily 
on the findings from studies that used various nonexperimental methods 
to describe the design, implementation, and management of a number of 
community programs for youth that appear to work at the community 
level. 



INSIGHTS FROM NONEXPERIMENTAL STUDIES 

Nonexperimental studies provide valuable insight about these pro- 
grams because they generally go beyond traditional evaluation input fac- 
tors, such as size, funding, activity focus, and participants served and 
help elucidate the realities of program practices and consequences. Al- 
though these studies cannot draw conclusions about the impact of pro- 
gram design characteristics on adolescent outcomes, they can help pro- 
gram planners and program staff build internal knowledge and skills and 
can highlight theoretical issues about the developmental qualities of pro- 
grams. Nonexperimental studies can also help develop a solid under- 
standing about program operations, components, and relationships in 
order to inform the design of future experimental evaluations. 
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The illustrations used throughout this chapter represent only a small 
sample of the many innovative community programs for youth. The 
extent to which and methods by which these programs have been sys- 
tematically studied varies. Consequently, they cannot be said to repre- 
sent “model programs” in a formal sense; instead, they illustrate the 
application of youth development concepts to program design dimen- 
sions. In Chapter 6 we examine findings from another set of evaluations 
on community programs for youth — those that use experimental meth- 
ods — and consider the additional insight gained from these evaluation 
methods. 

The committee examined in detail two studies of specific programs — 
Community Impact! (Association for the Study and Development of 
Community, 2000) and Save the Children (Terao et al., 2000) — and one 
study of a set of programs — Community Counts (McLaughlin, 2000). 
These studies used a variety of field-based and ethnographic methods to 
address youth development questions. They embrace an array of study 
purposes, employ various strategies to enhance the validity and reliabil- 
ity of the research, and provide important contributions to both knowl- 
edge and research. These three illustrations are summarized in Boxes 5- 
1, 5-2, and 5-3. Our discussion of programs in this chapter, however, is 
not exclusive to these three program illustrations. The programs identi- 
fied throughout this chapter are based on various sources of informa- 
tion, including program materials, site visits, and field observations by 
committee members. 

A WIDE RANGE OF PROGRAMS 

In order to understand how community programs for youth may 
incorporate features of settings, it is first useful to understand the diverse 
nature of these programs. The characterization of community programs 
for youth is complicated. The landscape of programs is vast. And the 
variety of terms used to describe the programs varies. At the most basic 
level, “programs are semi-structured processes, most often led by adults 
and designed to address specific goals and youth outcomes. This cat- 
egory incorporates a range of programs from those that are highly struc- 
tured, often in the form of curriculum with step-by-step guidelines, to 
those that may have a looser structure” (Benson and Saito, 2000: 126). 
They may be called after-school programs, youth programs, youth ac- 
tivities, community programs, extracurricular activities, or programs 
during out-of-school time or nonschool hours. 
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BOX S- 0 

Community Coymts 

An exploratory study that aimed to identify elements of community or- 
ganizations that youth judged effective and the accomplishments of the youth 
participants, Community Counts (McLaughlin, 2000) included exploratory 
research aimed at better understanding the organizational settings youth 
found supportive and inviting — settings that reflected many of the features 
of settings presented in Chapter 4. The sample was purposely biased to 
include “effective” programs; youth steered researchers toward organiza- 
tions they identified as good places to spend their time— places where they 
felt valued, respected, and challenged in positive ways. The organizations 
and activities studied were a diverse lot — Boys and Girls Clubs, dance 
troupes, YMCA/YWCAs, basketball teams, and improvisational theater. 
More than 1 ,000 youth participated in these groups; all were poor, and the 
majority were members of minority groups. 

During the first phase of the study, research associates living in each of 
the communities carried out primary data collection. These researchers 
spent full time for three years getting to know the communities, the youth, 
and their organizations. They and the principal investigators conducted 
interviews, observations, and focus groups with youth, community-based 
organizations, and community leaders over a three-year period. The study 
developed a strategy to engage youth in data collection and interpretation. 
Approximately five young people from the organizations in each of the three 
communities were recruited and trained to serve as ethnographers. These 
youth were responsible for interviews with youth and adults in their organi- 
zation and neighborhood and for providing field notes from activities that 
researchers could not attend. Phase 2 of the research continued these data 
collection strategies, employing “traveling” research associates instead of 
community-based researchers. Phase 2 also included a survey that asked a 
subset of questions from the National Education Longitudinal Survey of 
Youth (NELS:88) instrument in order to “locate” the characteristics and 
accomplishments of participating youth in terms of representative Ameri- 
can youth. 
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[SOX 5-2 v . . 

Community Impact! 

Community Impact! was founded in 1990 to help low-income neighbor- 
hoods across Washington, DC, invest in their youth through neighborhood- 
based programs focused on youth development, entrepreneurship, and aca- 
. demic enrichment. The Association for the Study and Development of 
Community and Community IMPACT! (Cl!) used a “utilization-focus” with 
three interdependent studies to evaluate Cl! efforts, to examine research 
and practice as it relates to Cl! strategies, and to assess Cl!’s organizational 
capacity (Association for the Study and Development of Community, 2000). 

The first study included personal interviews, archival data review, and 
evaluator observations. Data collection focused on nine domains of inter- 
est: (I) community climate, cooperation, and participation; (2) leadership; 
(3) program legitimacy; (4) community awareness; (5) steering committee 
membership; (6) committee activities and empowerment; (7) resources and 
technical assistance/training; (8) financial and partnership management; and 
(9) financial resources. 

The second study focused on providing knowledge and a new under- 
standing of what “community” means to community members (adults and 
youth) and how youth leadership affects a community and its members. 
They conducted both adult and youth focus groups, administered a youth 
survey, and conducted a literature review. 

The third study involved a questionnaire that asked program staff to 
evaluate the following six dimensions of their organizational structure: cul- 
ture, leadership, systems and structures, communication of information, 
teams, and evaluation. 



The institutional structure of programs can fundamentally affect the 
degree to which they address adolescent development, respond to local 
conditions, and provide appealing and safe settings. The Carnegie Coun- 
cil on Adolescent Development described youth programs through vari- 
ous categories (Carnegie Corporation of New York, 1992): 

0 Private, nonprofit national youth organizations: There are a num- 
ber of large national youth-serving organizations that have local 
franchises throughout the United States, and often internationally. 
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BOX 5-3 

Save the Children (U.S. Programs) 

Since 1997, Save the Children has been running an initiative called Web 
of Support to promote quality programs for young people ages 5 to 18 
during out-of-school time. Community organizations across the country, 
identified by Save the Children as Rural Community Partners or Urban 
Collaboratives, serve children and youth sponsored by Save the Children. 
The evaluation, conducted by the Aguirre Group, reports on the accom- 
plishments and outcomes of 43 Rural Community Partners (Partners) and 7 
Urban Collaboratives (Collaboratives) from October 1998 through Septem- 
ber 1999 (Terao et al., 2000). 

The evaluation was based on a participatory/empowerment model. This 
study documents the positive outcomes associated with children and youth, 
partners and collaboratives, regional and Home Office staff, and the Save 
the Children national network. The evaluation included a variety of data 
collection methods including content analysis of evaluation reports devel- 
oped by each participating partner and collaborative; conducting pre-post 
surveys of youth interns and new partners (through written surveys and 
through focus groups); conducting post surveys of youth-intern supervisors, 
pilot and first-year partners, and collaboratives facilitators; conducting tele- 
phone interviews with collaboratives members, and regional and home of- 
fice staff; conducting observations, during site visits and training; conducting 
pre-post adult surveys (staff, teacher, and/or parent); conducting parent in- 
terviews; developing and using observation checklists; and reviewing a col- 
lection of existing records (e.g., grades and test scores). 



Although these organizations share many common aspects, each 
has unique components within the structure of its program. For 
instance, the program content may vary and the demographics of 
the service populations may vary, depending on the local com- 
munity. 

© Grassroots youth development organizations: These autonomous 
community-based organizations are fundamentally independent 
from other organizations or institutions. While they generally do 
not operate in isolation, their work with youth does not depend 
on the acceptance or support of any single institution. 
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° Religious youth organizations: These organizations may vary in 
their particular program activities and focus, but they generally 
share the common objective of fostering moral and faith develop- 
ment. 

° Private community groups (i.e., adult service clubs, sports organi- 
zations, senior citizens groups, and museums): These organiza- 
tions sponsor a broad range of youth programs; although their 
primary mission is not to provide youth programming, they en- 
gage youth in various activities. 

° Public-sector institutions (i.e., public libraries, parks and recre- 
ation departments): These institutions often serve as a gathering 
point for adolescents and may offer activities and services specifi- 
cally to promote adolescent development. 

In addition to these categories, the committee also recognized that 
institutional collaborations, such as school-based programs being run by 
community-based organizations, offer many programs for youth. 

There is great diversity in the specific focus and character of commu- 
nity programs for youth. Community Counts, for example, examined 
120 community organizations that differed in nearly every objective way 
possible (McLaughlin, 2000). The Younger Americans Act (discussed in 
Chapter 9), introduced in the Senate in September 2000 and the House 
in January 2001, included a useful list of youth program activities: 

° Character development and ethical enrichment activities; 

° Mentoring activities, including one-to-one relationship building 
and tutoring; 

° Community youth centers and clubs; 

° Nonschool hours, weekend, and summer programs and camps; 

° Sports, recreation, and other activities promoting physical fitness 
and teamwork; 

° Services that promote health and healthy development and behav- 
ior on the part of youth, including risk avoidance programs; 

° Academic enrichment, peer counseling and teaching, and literacy; 

° Camping and environmental education; 

° Cultural enrichment, including music, fine, and performing arts; 

° Workforce preparation, youth entrepreneurship, and technologi- 
cal and vocational skill building, including computer skills; 

° Opportunities for community service; 

° Opportunities that engage youth in civic participation and as part- 
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ners in decision making; 

® Special-interest groups or courses, including video production, 
cooking, gardening, pet care, photography, and other youth- 
identified interests; and 

® Public and private youth-led programs, including ones provided 
by youth-serving or youth development organizations. 

To this list, the committee added program activities associated with 
such developmental passage rituals as bat and bar mitzvahs, American 
Indian rite of passage rituals, and Christian first communion and confir- 
mation ceremonies. 

There is little comprehensive information on the prevalence and dis- 
tribution of the various community programs for youth in this country. 
The Carnegie Council on Adolescent Development’s 1992 report, A 
Matter of Time , provided the most comprehensive summary of basic 
national statistics on the pervasiveness of youth programs (Carnegie 
Corporation of New York, 1992). Based on data from the National 
Center for Charitable Statistics, this study concluded that there were 
17,000 active youth organizations in the United States in 1990. No 
other national studies as comprehensive as this have been undertaken in 
the past decade, a period when there has been considerable increases in 
funding and opportunity for these programs. A variety of independent 
efforts to compile information about a particular set of youth programs 
have been conducted, but they are neither comprehensive nor national in 
their scope (National Collaboration for Youth, 1997). 

FEATURES OF COMMUNITY PROGRAMS FOR YOUTH 

The committee mapped the features of settings developed in the 
Chapter 4 against various program illustrations and drew some conclu- 
sions about effective strategies to incorporating features of positive de- 
velopmental settings. While there are fairly obvious links between some 
program dimensions and features of settings, there is also a great deal of 
overlap. For instance, programs that develop clear and consistent rules 
of behavior demonstrate appropriate structure; at the same time, these 
rules may help nurture an environment that promotes physical and psy- 
chological safety. 
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Physical and Psychological Safety 

Physical and psychological safety is fundamental to attract young 
people to programs and to keep them coming back. This requires both 
creating an environment that is safe, as well as handling conflicts among 
participants as they arise. 

The objective of some programs is to enable youth to just participate 
in safe environments free from pressures associated with violence and 
substance abuse. In many cases, accessibility makes a difference to safety, 
which in turn often affects participation. Some programs or facilities are 
too far for youth to get to conveniently, requiring a bus ride or long walk 
through uncertain neighborhoods. Other clubs or programs may be only 
a few blocks from a young person’s home but require navigating hostile 
gang territory. Hours of operation matter, too. Programs unavailable 
until after six in the evening, for example, have difficulty attracting youth 
at all (Cahill et al., 1993). Programs operating only one evening a week 
or that are closed on weekends also seem insufficient to sustain youth 
interest. Most appealing from youth’s perspective were organizations 
that provided reliable access to adults and safe space to meet daily and 
on weekends (McLaughlin, 2000). 

Sometimes maintaining an atmosphere of safety requires denying 
some young people participation. Directors describe the process as a 
sort of triage, in which difficult decisions are sometimes made to deny 
needy and deserving youth a place in the organization for the sake of the 
whole. For example, the director of HOME in Alameda, California, 
pays close attention to school records and will not accept (or continue to 
involve) youth with consistent records of failure. These youth, she feels, 
could erode the spirit of entrepreneurship and responsibility that is the 
group’s signature. The director of East Oakland’s Youth Development 
Center has more pragmatic concerns — the safety of the young people 
who come through the door every afternoon. The director explained 
that they could not serve everyone and still have an environment that is 
safe and supportive for everyone. 1 This means that the most needy 
youth — youth of most concern to society — are sometimes excluded. It 
also means that youth who could benefit from and contribute to the 
organization may be denied a space simply because the program is full. 

Several prevention studies have also documented a negative effect of 
programs that focus exclusively on adolescents already engaged in risky 
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behaviors, as described more in Chapter 6. For example, programs that 
put together a group of young people who are all already involved in 
problem behaviors often produce increases in the very behaviors the pro- 
grams were designed to reduce (Dishion et aL, 1999). These negative 
effects have been interpreted as the consequence of participation in a 
peer group comprised primarily of adolescents already actively involved 
in troubling behaviors. 



Clear and Consistent Structure Appropriate Levels of 
Adult Supervision 

Appropriate structure in community programs for youth includes 
developing clear and consistent rules and expectations, setting limits, and 
being clear about behavioral expectations. Settings with appropriate 
structure have predictability and consistency. The staff develop clear 
boundaries that take into consideration the age and developmental ma- 
turity of the youth involved. 

Appropriate structure is often based on the rules maintained by a 
program. Rules of membership, such as bans on gang colors, weapons, 
drugs, and alcohol, are an essential set of agreements and understand- 
ings; also important are rules about members treating each other and the 
adult leaders with honesty, and teamwork. Youth report that these 
guidelines for behavior are elemental to their own feelings of safety and 
comfort — especially as the program environment provides a safe haven 
in their neighborhood (McLaughlin et al., 1994). 

Appropriate structure is also based on the focus of the program and 
its underlying curriculum. Many community programs for youth attract 
young people of varying ages. Programs may explicitly seek to make the 
curriculum and program activities also reflect different developmental 
needs. 



Supportive Relationships 

Programs that focus on supportive relationships provide settings in 
which youth feel a strong sense of warmth, closeness, caring, support, 
and guidance from the adult leaders in the program. 

Community programs for youth provide opportunities to expose 
young people to caring adults who challenge them, encourage them to 
participate in positive experiences, and respect their opinions. Youth 
respondents to the Community Impact! survey indicated that they desire 
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and require guidance from adults (Association for the Study and Devel- 
opment of Community, 2000). This may be one of the most important 
characteristics of highly valued programs (McLaughlin, 2000). 

Programs vary in terms of the characteristics of the staff they em- 
ploy — by age, race, previous experience, and educational attainment. 
Some programs are staffed by full-time or part-time staff; others rely 
heavily on community or family volunteers. Adult leaders — both paid 
and volunteer — came from various personal and professional back- 
grounds in the programs reviewed in Community Counts. Some had 
been in military services; others had been teachers; many had worked in 
church groups or athletic teams all of their lives (McLaughlin, 2000). 
Save the Children programs involve paid and volunteer adults and teens, 
youth interns, teachers, and community elders (Terao et al., 2000). 
Participants in the Community Impact! survey place value on adults lead- 
ers who were getting or had gotten an education (Association for the 
Study and Development of Community, 2000). 

From the perspective of young people, supportive relationships are 
based less on the professional qualifications of the staff and more on the 
staff’s attitudes toward them (McLaughlin, 2000). Some community 
programs are led by adults deeply committed to young people and their 
futures. The staff that run these programs have an opportunity to influ- 
ence a young person’s sense of belonging, their sense of empowerment, 
and their connectedness to the program. 

For some youth, the strength of relationships may be heightened by 
interaction with adults of their own ethnicity or experience as role mod- 
els, coaches, and program administrators. Staff who are members of the 
same community from which the young people come may provide par- 
ticularly strong support. A participant explained, “The [program] really 
taught me how to survive on the street. Most of the staff members here 
grew up just like I did on the street and stuff like that so they really 
taught me how to stay out of trouble and protect myself.” 2 

Most important to developing connectedness and providing support 
and guidance is staff who are committed to a program and its young par- 
ticipants, who are consistent in the messages they teach, and who commu- 
nicate warmth and caring while setting clear boundaries and consistent 
rules and expectations (McLaughlin, 2000). These staff attitudes matter 
more than do questions of race, age, or ethnicity. Youth see staff who 
they perceive are their allies and who are committed and trustworthy. 



2 From field notes collected by committee member Milbrey McLaughlin. 
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Opportunities to Belong 

Promoting a sense of belonging is fundamental to attracting and re- 
taining the participation of young people, as well as helping them de- 
velop confidence and a personal identity. Young people need to feel 
included, regardless of their gender, ethnicity, sexual orientation, per- 
sonality, or physical, intellectual, or social limitations. 

A program’s curriculum and strategy describe what it does and how 
it carries out its mission and goals. A number of things about the nature 
of a program’s curriculum and strategy matter for youth involvement, 
the benefits youth derive from participation, and the sense of belonging 
that is nurtured. One is the quality of program content; another is the 
extent to which activities embed various learning goals. At the most 
basic level, a sense of belonging and inclusion requires that the program 
strategy attract and interest young people. “Activities for youth need to 
be attractive to the youth audience. This means having fun, fresh, and 
interactive things to do” (Morley and Rossman, 1997). Youth want 
challenging, age-appropriate programming. 

A program’s size and membership may also fundamentally shape its 
design and operation and its ability to adequately offer opportunities 
that promote meaningful inclusion. Membership matters not only to its 
approach to youth development but also to how it organizes itself to 
facilitate opportunities for youth. The target membership for a program 
may be broad or it may focus on a particular ethnic or religious group. It 
may be only for boys or only for girls. It may be restricted to a particular 
age group. Some programs reach out to disenfranchised or at-risk youth; 
others limit participation to young people who have maintained a certain 
grade point average or have applied or auditioned to participate in the 
program. Many programs seek a heterogeneous set of participants to 
build understanding and tolerance among young people. Many of the 
national organizations, such as Big Brothers/Big Sisters, focus their ac- 
tivities on a large, diverse group of community participants. Some other 
programs are targeted toward homogeneous groups in order to offer 
specific support, cultural awareness, a sense of belonging, and pride to a 
particular subgroup of youth. 

Both the Center for Young Women’s Development (CYWD) and the 
Lavender Youth Recreation and Information Center (LYRIC), for ex- 
ample, are organizations that nurture belonging among youth with par- 
ticular histories and experiences. They are committed to offering sup- 
ports and opportunities to socially marginalized youth — in the case of 
CYWD to young female prostitutes in San Francisco, and in the case of 
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LYRIC, to transgender, bisexual, lesbian, and gay youth (McDonald et 
al., 2001). 

Community programs for youth may engage a set of youth in com- 
munities that are particularly isolated and where youth have less access 
to social integration. For adolescents living in rural communities, where 
the proportion of parents working outside the home is the largest in the 
country, community programs for youth can nurture engagement and 
create a strong sense of belonging (Charles Stewart Mott Foundation, 
1998a). An after-school program in rural Kentucky (the Clinton County 
School District), for example, offers an academic summer camp to 100 
youth. These young people participate in sports activities, dancing and 
music, hunter education courses, computer skills training, communica- 
tions skills activities, and public speaking. Given the isolated nature of 
this Kentucky community, opportunities for special field trips or expo- 
sure to diverse skills training are more limited than in urban areas. For 
these reasons, the on-site program is complemented with a Spanish course 
taught on-line by a teacher 90 minutes away, and young people take 
electronic field trips by way of the Internet (Charles Stewart Mott Foun- 
dation, 1998a). 



Positive Social Norms 

Some community programs for youth are designed as drop-in activi- 
ties, where young people can come and go and participate in rotating 
activities of their choice. Other programs require youth to make a com- 
mitment to the program and as a result have high expectations for their 
involvement. These programs support prosocial norms by teaching youth 
responsibility to uphold certain rules of behavior, to be accountable to 
the program and its expectations, and to agree to live up to a set of 
morals and values. 

Participants in the East Oakland Youth Development Center, which 
offers a range of activities for young people and their families, are re- 
quired to make a commitment to the program through membership in 
one of the program’s teams, dance troupes, or clubs. And to become a 
member of one of these groups, participants have to agree to the pro- 
grams’ values, which encourage self-respect and respect among peers and 
adults. At all costs, the center enforces these established rules and expec- 
tations of respect. The objective is to help young people integrate these 
norms into their character and their behavior in other parts of their lives 
(McLaughlin et al., 2001). 
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Support for Efficacy and Mattering 

Many community programs for youth incorporate multiple oppor- 
tunities to build efficacy. Programs may vary in the extent to which they 
allow youth to participate in the leadership of the program. However, 
many programs believe that youth can play a variety of roles in design- 
ing, delivering, and evaluating activities. Youth participants may help 
identify needs and set goals; help design the structure, activities, and 
supports that will be attractive and accessible to youth; help staff under- 
stand what youth need and how to relate to them; help identify commu- 
nity and family issues that may be barriers for youth participation; and 
help create an environment for youth to positively contribute to their 
community. Some programs develop youth councils to systematically 
generate youth involvement. Others involve youth in responsible leader- 
ship positions around program activities, such as tutors, peer counselors, 
and event organizers (Burt, 1998). 

Community programs for youth that incorporate opportunities for 
efficacy may, in fact, be youth-centered or run entirely by adults. In 
practice, what often matters from the adolescent’s perspective is the 
stance about youth communicated by program goals and philosophy. 
Are program goals focused on youth as resources or as problems? Do 
youth see programs as resources to help them grow or succeed, rather 
than as efforts to “fix” them? They are likely to avoid or leave pro- 
grams that seem punitive or deficit-based and instead choose ones that 
acknowledge their assets and help them to develop their strengths. 
Youth-centered programs provide rich opportunities to support youth 
efficacy — for youth to experience leadership, assume responsibility, and 
develop problem-solving skills. 

Faced with declining enrollment of youth over 13 years of age, Loui- 
siana 4-H developed a survey to ensure that their curriculum and pro- 
gram strategy were designed around ideas that teens themselves indi- 
cated were of interest. They found that the topics of interest changed as 
young people got older. At higher grade levels, for instance, they were 
much more interested in jobs, careers, and options after high school. 
They also discovered that the traditional 4-H program topics of health, 
safety, and nutrition had to be packaged in terms of fitness or sports in 
order to attract adolescent interest. Although the youth did not want to 
discuss personal grooming, they were eager to participate in activities 
about fashion (Acosta and Holt, 1991). This program granted youth 
responsibility and supported efficacy by involving them in deciding the 
nature of the program activities. 
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There are programs that have explored including young people as 
evaluators of their programs. The Department of Children, Youth and 
Their Families in the City of San Francisco launched a comprehensive 
effort to promote leadership development among San Francisco youth. 
The city’s efforts included a youth-led evaluation program that trains 12- 
15 youth in research, planning, and evaluation. This component of the 
city’s work was designed both to create new leadership among young 
people and to improve the effectiveness of the organizations being 
funded, from a youth perspective (Department of Children, Youth and 
Their Families, 2001). 



Opportunities for Skill Building 

At the heart of many community programs for youth are opportuni- 
ties for skill building. Programs can use a wide variety of activities, such 
as community service, adventure and outdoor activities, art, drama, 
music, religious instruction, sports, cultural awareness, academic im- 
provement, and career preparation, to support positive youth develop- 
ment and to meet the program-specific objectives. The exact content or 
focus (e.g., sports, music, community service) may be designed to attract 
adolescents to the program, while the curriculum may focus more on 
developmental skills (e.g., cooperation, creativity, communication). Save 
the Children programs, for example, include activities to promote cogni- 
tive ability and intellectual growth, as well as social and emotional 
growth, through a range of activities, including tutoring, computer train- 
ing, recreation activities, team-building programs, and youth leadership 
activities (Terao et al., 2000). 

Programs focusing on a specific activity can support skill building in 
a number of different areas. An arts program, for example, may involve 
youth in researching their cultural history and painting community mu- 
rals to reflect what they learn. A sports program may focus not only on 
skills development, but also on teamwork and problem solving 
(McLaughlin, 2000). Library-based programs encouraging teens to read 
can provide a variety of educational, recreational, and cultural opportu- 
nities that help the participants improve academic performance, develop 
social skills, learn new hobbies, and build self-esteem. Through reading 
opportunities, these programs focus on critical thinking, communication 
skills, social skills, and creativity (American Library Association, 2000). 

Examples of skills that are incorporated into programs are plentiful. 
Volunteers of Campfire Boys and Girls provide youth with assistance, 
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guidance, and direction in a myriad of programs, including citizenship 
and community leadership, health and safety, food and nutrition, en- 
ergy, economics, jobs and careers, natural resources, sciences, and plant 
and animal production (Campfire Boys and Girls, 2000). “Always on 
Saturday,” a teen pregnancy program for black boys in Hartford, Con- 
necticut, focuses on teaching life skills. The program curriculum incor- 
porates general decision-making, problem-solving, planning, and goal- 
setting techniques taught through life examples that both the director 
and the youth provide (Ferguson, 1994:74). 

Programs that address a number of developmental outcomes with 
each activity offer what is referred to as an embedded curriculum 
(McLaughlin, 2000). Embedded within an organization’s programs are 
activities that build a number of competencies and life skills. For ex- 
ample, YO!, a Northern California youth-run newspaper, provides jobs 
for youth, training in reporting, writing, and production, and experience 
in the business side of newspaper production. An after-school dance 
program for youth integrates cultural history into the dance lessons and 
gives them responsibility for program planning, advertising, and market- 
ing. A championship inner-city basketball team begins each after-game 
briefing with an assessment of teamwork and sportsmanship. Programs 
such as these teach skills — writing, dance, and basketball — but they also 
build skills around responsibility, leadership, persistence, and connec- 
tion to the family, schools, and the community. 

Integration of Family, School, and Community Efforts 

Community programs for youth offer many opportunities for the 
integration of families, schools, and the broader community. Thus far 
we have described the specific ways in which individual organizations 
design and operate programs. But youth development depends not only 
on the independent efforts of programs, but also on these efforts in col- 
laboration with the community as a whole. 

Peter L. Benson, president of the Search Institute, describes a com- 
munity by three characteristics: (1) a shared commitment, in which 
adults, organizations, and community institutions unite to affirm their 
responsibility to youth and their ability to make a difference and take 
action; (2) daily opportunities for individuals to acknowledge, encour- 
age, and support youth; (3) intentional involvement of organizations, 
institutions, and systems — including schools, congregations, youth orga- 
nizations, businesses, health care providers, and foundations — in pro- 
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grams and activities that provide youth with positive experiences 
(Benson, 1996). 

Given the focus of this report, the committee was particularly inter- 
ested in highlighting strategies through which community programs for 
youth integrate their activities with the broader community. Many pro- 
grams in fact do target the community more broadly, seeking to reach 
and influence young people, their families, and other community mem- 
bers, organizations, and businesses. HOME, for example, is a commu- 
nity-based youth membership organization where young people through- 
out the city of Alameda, California, collaborate with each other and 
adults to create important projects and innovative businesses. The 
achievements made through these youth-initiated projects pave the way 
for adults to embrace youth as contributing members of the community 
and for youth to learn the skills they need to be effective, enterprising 
citizens. 

As well, many programs that are focused on individual-level out- 
comes also influence community-level outcomes. Community programs 
for youth may, in fact, focus beyond individual-level outcomes to 
strengthen community capacity. Where youth live, what their communi- 
ties are like, and what the general climate is like in their neighborhood — 
factors of safety, schools, and economic stability, for example — have sig- 
nificant impacts on individual development (National Governors’ 
Association’s Center for Best Practices, 1999). Youth participants in the 
Community Impact! survey, for example, specifically reported that they 
perceived a supportive community as one with adequate resources, in- 
cluding such activities as community programs for youth (Association 
for the Study and Development of Community, 2000). 

Most young people grow up in families, spend much of their time in 
schools, and are surrounded by communities, so incorporating opportu- 
nities for developmental outcomes into their lives demands coordinated 
efforts among these stakeholders. “Youth development requires collabo- 
ration. No single community organization can provide the range of de- 
velopmental, preventive, and intervention programs and services required 
to give young people the experiences they need to mature into successful 
adults. Rather, creation of such programs requires collaborative plan- 
ning by a community’s youth-serving agencies, other social services and 
educational institutions, policy makers, community leaders, and young 
people” (National Clearinghouse on Families and Youth, 1996). 

Agreeing on what communities want for all young people is an im- 
portant factor in supporting youth development. Youth service provid- 
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ers, in conjunction with youth, parents, and community members, need 
to develop a shared understanding of the needs of the young people in 
their community. They must decide what youth need to develop into 
healthy, self-sufficient, and involved adults and how the community can 
best meet those needs. Through that collaborative process, they can 
begin discussing a youth development framework and how it might trans- 
late into a vision for young people in their community. 

The committee explored in more depth a few particular strategies to 
integrate community programs for youth with broader community pri- 
orities. 



Community : Wide Initiatives 

Over the past 10 years, there has been growing interest in commu- 
nity-wide programming initiatives for youth. Consistent with the impor- 
tance we place on the interconnections across the various social settings 
in which adolescents live, these community-wide initiatives have sought 
to take a broader view of the developmental needs of youth. Also grow- 
ing out of a community development perspective, these initiatives have 
focused on a coordinated effort to increase the services and programs for 
youth across the community. Communities That Care in Pennsylvania, 
based on a curriculum developed by Hawkins, Catalano, and Associates 
(1992; Development Research and Programs, Inc., 2000) and Public/ 
Private Ventures Community Change for Youth Development (Gambone, 
1997) are two prime examples of these efforts. 

These types of initiatives are particularly noteworthy, since they seek 
to provide a coordinated approach to meeting the needs for positive 
youth development. Such initiatives also offer the possibility of imple- 
menting a monitoring and self-evaluation system that regularly assesses 
the needs of youth and matches them against the range of services and 
programs provided by the community. Such a coordinated approach 
appears to have a good chance of actually ensuring the adequacy of 
community-wide services for youth. 

Communities That Care . The Communities That Care approach, devel- 
oped by David Hawkins and Richard Catalano, is an operating system 
for prevention. It helps states and communities assess and prioritize 
needs, choose the best approaches to promote youth development and 
prevent problem behaviors based on those needs, and evaluate the effec- 



The Landscape of Community Programs for Youth 



139 



tiveness of policies, programs, and actions that have been implemented 
in their communities. 

The scientific knowledge base underlying this approach includes 
understanding the root causes of both positive and problem behaviors. 
These root causes include risk factors for adolescent problem behaviors — 
those factors associated with an increased likelihood of such behaviors. 
Root causes also include protective factors — those factors that appear to 
buffer the effects of risk and promote positive youth development even in 
the presence of risk. The approach is designed to reduce risk in ways 
that enhance protective factors. The knowledge base also includes iden- 
tification of programs, policies, and actions that have demonstrated their 
ability to reduce risk and enhance protection. 

The model began with a field test in 1988 in Washington State with 
25 communities, then in 1989 in Oregon with 39 communities. It has 
now been adopted by the U.S. Department of Justice’s Office of Juvenile 
Justice and Delinquency Prevention as the prevention component of their 
comprehensive strategy and is offered as training to assist communities 
to spend Title V funds. The states of Colorado, Illinois, Kansas, Louisi- 
ana, Maine, Michigan, New York, North Carolina, Oregon, Pennsylva- 
nia, Utah, and Washington have adopted this approach state-wide in a 
single agency or in multiple youth-serving agencies. It has allowed them 
to take the lead in prevention, get funds transferred, and helped to edu- 
cate citizens and practitioners about this effective approach to preven- 
tion. 

The state of Pennsylvania (in collaboration with federal funding 
sources) serves as one example of the use of this model. The state made 
a commitment to help communities put together a coordinated effort 
around prevention. Communities were encouraged to combine the pro- 
cesses and skills of community building and community development 
with the evidence emerging from the field of prevention science in order 
to evaluate community needs and resources; design a more comprehen- 
sive, coordinated set of services and programs for children, youth, and 
families; implement their design; and put in place an extensive evaluation 
component to monitor progress and improve design. Communities ap- 
plied for planning and training grant funds. At present, the state plans to 
provide training for up to 20 new communities per year until the demand 
for this program is met. The evaluation of this effort, based on a quasi- 
experimental design, is just beginning. Initial results focus only on imple- 
mentation in a limited number of communities. Reports over the next 
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FIGURE 5-1 Theory of Change. Source: Gambone (1997). 



several years will reveal a great deal about this effort (Hawkins, Catalano, 
and Associates, 1992; Development Research and Programs, Inc,, 2000). 

Community Change for Youth Development. The Community Change 
for Youth Development demonstration, initiated by Public/Private Ven- 
tures, involved selecting three communities (St. Petersburg, Florida; 
Savannah, Georgia; and Austin, Texas) and working with them to 
develop and implement an integrated set of activities for youth ages 12 to 
20 (Gambone, 1997). Public/Private Ventures approached communities 
with a very well-articulated theory of change (see Figure 5-1) and offered 
technical assistance during a 6-month planning period, followed by par- 
tial support of the implementation phase. 

The three communities with the most comprehensive plan that was 
consistent with the goals and developmental perspective were selected. 
Unlike the Communities That Care initiative, this project involved little 
state funding. Instead, the communities received some support and were 
required to identify and recruit other sources of funding. 

Two things are very exciting about this community effort. First, the 
core concepts identified were based on solid research and fit with the 
positive developmental features of settings outlined in Chapter 4. Sec- 
ond, initial studies of the planning and implementation phases suggest 
that communities can come together to increase the range of opportuni- 
ties available to their youth (Gambone, 1997). Nonexperimental evalu- 
ations of this effort are ongoing, and a great deal will be learned from 
these studies. 

School-Based Community Centers. Schools often serve as a gathering 
spot for community activity focused on the development of its youth. 
Two schools in New York City, I.S. 218 and P.S. 5, decided to extend the 
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use of their existing facilities to include a multiservice center providing 
services to neighborhood children and families, through the aid and guid- 
ance of the Children’s Aid Society and other partners. A survey of par- 
ents indicated concern about homework patterns, so the program began 
as a homework tutorial. Gradually it has expanded to include computer 
labs, dance classes, arts programs, and career readiness support. Re- 
sources are also available through the program to parents and the com- 
munity (U.S. Department of Education, 2001). Other similar models 
now exist across the country. 



Intermediary Organizations 

Closely related to these community-wide initiatives are a wide vari- 
ety of capacity-building intermediary organizations that have emerged 
over the past decade. These organizations have grown out of a need to 
advance the vision of comprehensive promotion and implementation of 
youth development. These organizations are helping to chart, support, 
implement, and sustain multiple changes for multiple stakeholders, such 
as youth development providers, funders, and researchers (Academy for 
Educational Development, 1999). 

The Community Network for Youth Development (CNYD), an ex- 
ample of an intermediary organization located in San Francisco, Califor- 
nia, has been instrumental in promoting a youth development approach 
and supporting youth workers and directors. Through its Learning Net- 
work, directors and youth workers become familiar with best practices 
that support youth to build relationships with other youth and adults, 
participate in decision-making and leadership roles, become involved in 
the larger community, and develop skills and knowledge through their 
participation in challenging and interesting learning opportunities. In 
addition, the Learning Network provides a shared space in which direc- 
tors and youth workers throughout the Bay area can jointly reflect on 
youth development practices and learn from one another regarding what 
works in practice. There are a number of other such capacity-building 
intermediaries across the country, such as Youth Net in Greater Kansas 
City, Missouri, the Hampton Coalition for Youth in Hampton, Virginia, 
B. BRAVO for Youth in Baltimore, Maryland, and the Chicago Youth 
Agency Partnership. Intermediary organizations are discussed more in 
Chapter 9. 

There are a number of other efforts to coordinate learning among 
individuals and organizations involved in identifying and developing 
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youth development research and policies. The Harvard Family Research 
Project, for instance, developed the idea of learning communities as one 
way to institutionalize continual and coordinated self-examination. The 
Forum for Youth Investment (formerly the International Youth Founda- 
tion) is also involved in such efforts to help community programs flour- 
ish. 



Faith-Based Organizations 

Faith-based organizations have long been important providers of 
services to young people and the broader community, creating links be- 
tween youth, families, and the community. Research on faith-based in- 
stitutions and the role of religious organizations, such as churches and 
synagogues, suggests that they can contribute to community-wide efforts 
to promote youth development in several key areas, helping to reduce 
risky behaviors, building a value base from which young people make 
decisions, and involving a variety of people across the life span. While 
schools and social service agencies reach only targeted populations, con- 
gregations often touch a cross-section of the population. Nearly 40 per- 
cent of Americans say they attend some form of worship regularly and 
65 percent are members of a church or synagogue (Saito and Blyth, 
1992). 

These institutions may attract increased attention with President 
George W. Bush’s focus on faith-based initiatives. President Bush has 
proposed to allow religious groups to compete on an equal basis with 
secular organizations for federal grants and to create a nationwide faith- 
based initiative. This has taken the form of the White House Office of 
Faith-Based and Community Initiatives, which plans on using govern- 
ment subsidies to prompt religious and community organizations’ role in 
combating such problems as juvenile delinquency and drug abuse. 

Catholic Charities is a good example of a faith-based national orga- 
nization that stimulates local affiliates to undertake new activities, offers 
training and technical assistance in their ongoing work, assists with fund 
raising, and coordinates public policy advocacy. Two current examples 
of initiatives emanating from the national office of Catholic Charities are 
illustrative. Catholic Charities has been encouraging affiliates to get in- 
volved in restorative justice for young people who have gotten into 
trouble with the law. For example, Project Payback in Newark, New 
Jersey, is a program that allows young people to avoid incarceration by 
working in the community on service projects that help victims of crime. 
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Catholic Charities also encourages local affiliates to get involved in de- 
livering treatment services that are a key part of the drug court model 
now being replicated in many communities (Catholic Charities USA, 
2000). Leaders of Tomorrow in Cleveland, for example, helps young 
people convicted of selling drugs to find and keep jobs and stay in school. 
Catholic Charities uses convening people, e-mail, and publications to let 
its affiliates know about new activities it encourages them to undertake 
(Catholic Charities USA, 2000). 

Another example of the ways in which the juvenile justice system has 
become involved in forming a partnership with faith-based community 
organizations is the Boston Ten-Point Coalition. Responding to escalat- 
ing violence, black clergy joined with the Boston police force to create a 
coalition, aimed at reaching out to at-risk youth and gang members 
through “adoption” of gangs, patrolling neighborhoods, counseling, and 
using the church as a community center. The coalition, working with 
law enforcement and social service officials, has been successful in reduc- 
ing gun violence and formulating future plans for a program that will 
help create entrepreneurial businesses run by former gang members, who 
in turn, will employ other former gang members (Congress of National 
Black Churches, 2001). 

Project SPIRIT (Strength, Perseverance, Imagination, Responsibility, 
Integrity, and Talent) is an after-school, church-based curriculum pro- 
gram for students ages 6-12. The program, run by the Congress of Na- 
tional Black Churches, is built on the idea that church is a major institu- 
tion in the lives of many black families. By joining together parents, 
pastors, community and business leaders, and politicians, the program 
aims to provide youth with a safe haven for teaching and learning. Youth 
participants engage in a variety of activities, including life skills enhance- 
ment programs, after-school tutorials, and Saturday School. Project 
SPIRIT, which has spread to at least eight states, also provides parents 
with education, pastoral counseling, and training (Congress of National 
Black Churches, 2001). 

Community -Based Ceremonies for Youth Development 

As we have described, public and private organizations often pro- 
vide communities with programs to support young people. However, 
communities themselves also often initiate and maintain vital programs 
to nurture their young members — particularly through unique programs 
rooted in the communities’ own cultural traditions. 
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Among many Jewish communities in America, perhaps the single 
most important rite is the celebration of puberty, the bar mitzvah (for 
males) and bat mitzvah (for females) (Neuser, 1994). The bar/bat 
mitzvah 3 (Diamant and Cooper, 1991) celebrates the coming of age of 
young men and women, after which the community regards them as 
adults, obligated to fulfill Judaism’s religious commandments. While the 
rite varies among congregations, three elements are ubiquitous: the young 
person reads from the Torah (Old Testament) before the community, 
gives a speech, and holds a celebration (Diamant and Cooper, 1991). 
The ceremony represents the social order of the Jewish community and 
affirms the place of the youth and their family in that order (Liebman, 
1990). Family and community members begin preparing the young man 
or woman at least one year before the ceremony and are deeply involved 
throughout. Community members teach the youth to read and speak the 
Hebrew language, instruct them on the ceremonies of the bar/bat 
mitzvah, direct their study of the particular passage of Torah to be read, 
and tutor them as they prepare their speech. The bar/bat mitzvah and 
the preparations for it incorporate the support of relatives and the larger 
community. 

Navajo communities hold a coming-of-age ceremony for young 
women, called kinaalda. Navajo communities have maintained kinaalda, 
part of the larger Navajo Blessing Way, and it is now a most anticipated 
Navajo ceremony. Shortly after a girl announces the beginning of her 
first menstrual cycle, relatives and community members begin the formal 
ceremony, which lasts two to four days. With the assistance of family 
and community elders, kinaalda instills young girls with a pride in their 
cultural traditions, identity, and community, as well as signifying their 
coming life (Roessel, 1993; see also, Ryan, 1998). Kinaalda mobilizes 
family and community support around a young woman’s growth and 
integration into the Navajo social order. Community programs that sup- 
port youth, such as the bar/bat mitzvah and the kinaalda, exist in many 
different communities — Catholic first communion and confirmation, 
Mexican and Mexican American quincinera ceremonies for young 
women, Afrocentric coming-of-age programs, religious missions among 



3 One author posits, “The differences between bar and bat mitzvah have been steadily 
diminishing to the point that today, in many congregations, they are virtually indistin- 
guishable,” thus, we refer to the bar mitzvah and the bat mitzvah as “bar/bat mitzvah” 
(Diamant, 1991). 
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Latter-Day Saints, debutante balls, and the culture and language schools 
found among such ethnic communities as Chinese Americans and Japa- 
nese Americans. Research has only begun to explore the similarities, 
connections, and benefits of such community efforts to youth develop- 
ment. 



SUMMARY 

Program providers, program administrators, community leaders, and 
policy makers face a variety of choices in developing, implementing, sup- 
porting, and sustaining successful community programs for youth. The 
committee draws several conclusions from a review of illustrative com- 
munity programs for youth and the ways in which these programs incor- 
porate features of positive developmental settings into their design and 
implementation. 

Community programs have the potential to provide opportunities 
for youth to acquire personal and social assets and experience features of 
positive developmental settings. Among other things, these programs 
can incorporate opportunities for physical, cognitive, and social/emo- 
tional development; opportunities that address underlying issues of eth- 
nic identity and intergroup relationships; opportunities for community 
involvement and service; and opportunities to interact with caring adults 
and a diversity of peers. 

There is great diversity in the design, approach, and focus of com- 
munity programs for youth. Priorities vary among the diverse programs 
and therefore may emphasize different program features. Mentoring 
programs, for example, may focus on creating supportive relationships 
and developing a sense of belonging and inclusion. Programs that em- 
phasize sports activities, for example, may place greater priority of devel- 
oping team building and physical skill building. Priorities vary, and con- 
sequently program features vary. 

No single program can necessarily serve all young people or incor- 
porate all of the features of positive developmental settings. Diverse 
opportunities are more likely to support broad adolescent development 
and outcomes for a greater number of youth. As noted in Chapter 4, 
communities that are rich in opportunities reduce adolescent risk and 
increase positive development for a greater number of young people. 
This further supports the conclusion that communities need to offer 
multiple opportunities to experience positive developmental settings. 
Community-wide approaches to developing and implementing commu- 
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nity programs for youth are more likely to meet the needs of the diverse 
population of adolescents. Programs for youth offered by more than one 
organization — in schools, community centers, or both — focusing on 
different areas of interest and through different kinds of curricula pro- 
vide the greatest opportunity for young people to acquire personal and 
social assets. 

Finally, collaboration among researchers, providers, funders, and 
policy makers is important in order to develop and support community- 
wide approaches and implement a coordinated approach to designing, 
delivering, and evaluating community programs for youth. 



CHAPTER 6 



Lessons from Experimental 
Evaluations 



indings from nonexperimental and small scale quasi-ex- 
^^perimental studies of community programs for youth pro- 
vided the foundation for the descriptions in Chapter 5 of 
programs considered to be effective by participants, evalu- 
ators, observers, and qualitative researchers. In this chap- 
ter we summarize the committee’s review of findings from 
experimental and large-scale quasi-experimental evalua- 
tions of community programs for youth. The committee 
examined several meta-analyses and review articles that 
summarize the findings from many different studies of 
community programs for youth and considered in more 
detail three specific program evaluations. 

This examination had four primary objectives. First, 
we were interested in whether there is evidence from the 
most rigorous evaluations available that community pro- 
grams for youth make a difference in the lives of their par- 
ticipants. Second, we wanted to know whether the pro- 
grams that had received these types of rigorous evaluations 
included either the program features outlined in Chapter 4 
as potentially important components of community pro- 
grams for youth or the personal and social assets outlined 
in Chapter 3 as potentially important targets for these pro- 
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grams. Third, when this information was available, we wanted to know 
whether the program features hypothesized to be important in Chapter 4 
were indeed important in both facilitating positive youth development 
and preventing the emergence of serious problems. Finally, as a lead-in 
to the next chapter, we also wanted to assess the quality of these evalu- 
ations. We include in this chapter comments on whether the evaluations 
selected for inclusion in this chapter meet the most rigorous methods of 
evaluation — described in Chapter 7 — that can be used with community 
programs for youth. 

REVIEWS AND META-ANALYSES OF EVALUATIONS 

The committee reviewed seven reputable reviews and meta-analyses 
of prevention and promotion programs for youth from the fields of men- 
tal health, violence prevention, teenage pregnancy prevention, and youth 
development. 1 We considered reviews that included both programs for 
youth with a primary focus on prevention and programs explicitly fo- 
cused on a youth development framework since, as explained previously, 
the committee found the distinction between prevention and positive 
youth development not very clear in practice. Programs with prevention 
goals, for example, often included components common to programs 
with youth development goals. Details of the programs included in the 
meta-analyses reviewed are summarized in Table 6-1. 

As noted, the primary objective of reviewing these meta-analyses was 
to provide our best assessment of the extent to which community pro- 
grams have beneficial effects for youth. Our secondary objective was to 
determine the extent to which these programs incorporate the features of 
positive developmental settings developed in Part I and whether there is 
evidence of links between these program features and positive youth 
outcomes. Since none of the programs were designed with these specific 
assets and features in mind, we often had to make assumptions about 
likely features from the descriptions of the programs included in the vari- 
ous reviews. Through this review, we also identified the strengths and 
limitations of these evaluations. 



a We included reviews and meta-analyses published between 1997 and 2000 that ap- 
peared in either published, professionally reviewed journals, or selected government docu- 
ments. In the latter category, only government documents using rigorous methods of re- 
view were included in order to reduce the potential biases associated with reviews conducted 
by groups with high stakes in positive or negative conclusions. 
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We begin with meta-analyses focused nominally on mental health 
promotion and mental illness/problem behavior prevention programs 
because these have the most rigorous evaluations. There are several rea- 
sons for this: first, there is a long tradition of both mental health promo- 
tion and mental illness/problem behavior prevention work; consequently, 
these programs have had time to develop and to have comprehensive 
rigorous evaluations completed. Second, many of these programs are 
being conducted in school buildings during the official school day. These 
two characteristics make it much easier to conduct a successful random- 
ized trial design evaluation because the participants are drawn from a 
“captive” population. Conducting such evaluations in community pro- 
grams is much more difficult precisely because participation is voluntary. 
We say more about this later in this chapter and in Chapter 7. We then 
move onto the meta-analyses and summative reviews of largely out-of- 
school time community programs. 



Mental Health Programs 



Durlak and Wells 

Durlak and Wells (1997, 1998) conducted two meta-analytical re- 
views of primary and secondary prevention mental health programs op- 
erating prior to 1992 for youth under the age of 19. (Primary prevention 
programs intervene with normal populations to prevent problems from 
developing. Secondary prevention programs target individuals already 
at risk or exhibiting problems). Both meta-analyses included only pro- 
grams with a control group of some type (e.g., a group that is not partici- 
pating in the program or a group that is on a waiting list to participate in 
the program). Randomized designs were used in 61 percent of the pri- 
mary prevention program evaluations and 71 percent of the secondary 
prevention program evaluations. The primary prevention review (Durlak 
and Wells, 1997) included 177 programs; the secondary prevention re- 
view (Durlak and Wells, 1998) included 130 evaluations. Finally, most 
of these programs took place in schools (a likely reason that these studies 
had such low attrition rates of young people leaving the program before 
completion and final testing). 

In general, the results suggest that preventive mental health programs 
can be effective across a variety of psychological outcome measures for 
periods of up to two years following the intervention exposure. They are 
particularly effective at increasing such personal competencies as 
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assertiveness, communication skills, feelings of self-confidence, and skill 
performance, assets consistent with the committee’s framework. More 
specifically, the meta-analysis of the primary prevention programs 
(Durlak and Wells, 1997) revealed that most programs significantly re- 
duced problems (e.g., anxiety, behavior problems, and depressive symp- 
toms) and increased competencies. 

Durlak and Wells (1997, 1998) also compared the effects of envi- 
ronment-centered versus person-centered approaches. Person-centered 
programs worked directly with individuals using techniques based on 
social learning theory (either modeling appropriate behaviors or rein- 
forcing appropriate behaviors) and other direct instructional approaches 
focused on educational and interpersonal problem solving. Environment- 
centered programs tried to change either the home setting (through par- 
ent education about child development and changing parental attitudes 
and childrearing techniques when appropriate) or the school setting (of- 
ten through teacher training in interactive instructional techniques and 
classroom management skills). Parent education was often used as a 
general descriptor, but all of the person-centered programs were effective 
for some outcomes, particularly for increasing competencies. Of the 
environment-centered approaches, only school-based programs were ef- 
fective, and these were more effective at increasing competencies than 
reducing problems. Most of the school-based environment-centered pro- 
grams focused on changing the psychological and social aspects of the 
classroom environment through increasing either interactive instructional 
techniques or effective classroom management techniques. 

In their secondary prevention meta-analysis, Durlak and Wells 
(1998) compared the effectiveness of behavioral, cognitive-behavioral, 
and nonbehavioral treatments. 2 In general, all three treatments were ef- 
fective at both problem reduction and competency enhancement. In ad- 
dition, cognitive-behavior treatment was more effective than either be- 
havioral treatment or nonbehavioral treatment at reducing mental health 
problems, and the behavioral treatments were more effective than the 
nonbehavioral treatment at improving children’s competencies. 



2 Reinforcement, modeling, and desensitization procedures were the behavioral treat- 
ments used in these interventions. The cognitive-behavior treatments emphasized self- 
instructional training and other ways of using cognitive processes to modify behavior. The 
nonbehavioral treatments mostly used classic talking analytic techniques (the classic situa- 
tion in which a client talks with a therapist about his or her problems or concerns) for older 
children and activity-oriented play therapy for younger children. 
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Because these programs are based on well-established clinical theo- 
ries, they have a strong theory of change. 3 Little information about 
these theories, however, was included in the information provided by the 
programs, and very little information was provided about the quality of 
the services actually provided. Such information is critical if these pro- 
grams are to be implemented in other settings and programs by staff 
members who are not clinical psychologists or social workers. Certainly 
the primary prevention efforts should be replicable in after school 
community-based programs. But more information will be needed about 
the specifics of the programs before this is possible. 

Greenberg and Colleagues 

Greenberg and colleagues (1999) reviewed 130 universal, selective, 
or indicated mental illness prevention programs for children and adoles- 
cents. The universal prevention programs targeted whole populations of 
youth. The selective programs targeted individuals or subgroups identi- 
fied as at risk for developing mental disorders. The indicated prevention 
programs targeted individuals identified as having early warning signs of 
mental disorders but not yet meeting diagnostic criteria. Out of 130 
total programs, researchers selected 34 using the following criteria: a 
randomized experimental design or quasi-experimental design with a 
comparison group; pretest and posttest measures; a written manual speci- 
fying the theory and procedures used in the program intervention; a 
clearly defined sample, with adequate information about their behavior 
and social characteristics; and some evidence of positive mental health 
outcomes. Follow-up assessments were preferred but not required. This 
review focused less on the personal and social assets identified in the 
committee’s framework and more on the features of the programs them- 
selves and on prevention of problem behaviors. In general, the research- 
ers concluded: 

1 . Multiyear preventive programs produce longer-lasting effects than 
short-term programs. 



3 “Theory of change” is described as a clear, substantive theory that explicitly states the 
process by which change should occur. Ideally, this theory should be the driving force in 
program development and should guide the decision of what to measure and how. See 
Chapter 7 for elaboration. 
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2. Preventive program interventions should be directed at risk and 
protective factors 4 rather than at categorical problem behaviors, such as 
school dropout, delinquency, substance abuse, and teenage pregnancy. 

3. The few studies with follow-up data suggest possible “sleeper ef- 
fects” in program benefits (that is, some programs showed a greater ef- 
fect at a time somewhat distant from the end of the treatment than im- 
mediately following the intervention). If this is true, programs that do 
not collect follow-up data may underestimate the impact of their pro- 
gram. 

4. Prevention programs targeting multiple domains (i.e., individual, 
school, and community) are more effective than programs targeting one 
domain. 

We looked more closely at whether these conclusions held true for 
the 10 programs targeting 10- to 18-year-olds (see Table 6-1 for details). 
Do short-term programs produce time-limited benefits? This was diffi- 
cult to determine for this subset of programs because half of the eight 
short-term program evaluations (less than one year) did not do follow- 
up testing. Of the three programs that did follow-up testing, two found 
mixed results and one found positive follow-up effects. These three pro- 
grams are summarized below. 

The Adolescent Transition Project randomly assigned participants to 
one of four groups: teen focus, parent focus, teen-parent focus, and a 
self-directed control group. The teen focus group received training in 
self-regulation development along with skill development exercises. The 
parent focus curriculum provided training for parents in parent manage- 
ment skills in areas such as setting appropriate limits and problem solv- 
ing with teens. The combined parent-teen group used peer consultants 
to open discussions between teens and parents on issues of self-regula- 
tion, parent-child interaction, and communication patterns and life skills. 
In the comparison group, the teens were provided with self-directed in- 
structional materials focused on self-regulation and life skills develop- 
ment. After 12 weekly 90-minute sessions, the parents and adolescents 
in all three treatment groups reported significantly less home-based prob- 
lem behavior than at the pretest; in contrast, however, there was an in- 



4 Risk factors, such as academic failure or poverty, are variables associated with a greater 
likelihood of negative or undesirable outcomes. Protective factors, such as warm, nurtur- 
ing adult relationships, and the personal and social assets outlined in Chapter 3, reduce the 
likelihood of problem behavior in the presence of risk. 
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crease in teacher reports of school problem behavior for the adolescents 
in the teen-focused treatment group at the one year follow-up. No ex- 
planations were provided for these patterns of results or for why school 
problem behavior may have increased in the teen-focused treatment 
group. 

In the Coping with Stress Course, a subset of targeted adolescents 
with elevated self-reported depressive symptomatology were randomly 
assigned to 15 group clinical counseling sessions of 45 minutes each. 
The “treated” adolescents’ reports of depressive symptomatology de- 
clined more that the control adolescents from pretest to posttest, but this 
difference had disappeared by the 12-month follow-up. In contrast, how- 
ever, there were fewer cases of major depressive disorder and dysthymia 
(a milder form of depression) in the treatment group than in the control 
group at the follow-up testing. 

Only the Penn Prevention Project found unambiguous evidence of 
both follow-up and sleeper effects. This selected intervention program 
targeted children ages 10 to 13 at risk due to elevated depressive symp- 
toms or family conflict. The randomly selected intervention groups met 
once each week for 12 weeks after school for 1.5 hours. Postintervention 
data showed fewer depressive symptoms, better classroom behavior, and 
reduced likelihood of attributing negative events to stable enduring causes 
for the treatment group compared with the “untreated” control group. 
While levels of both the experimental and control groups’ depressive 
symptomatology increased over the 24-month follow-up period in the 
Penn Prevention Project, this increase was larger in the control group 
than in the treatment group. Also, even though there were no significant 
differences at the posttest, parents of the intervention group reported 
more improvements in the children’s home behavior at the 24-month 
follow-up than parents of the control group. Effects were maintained at 
the 12-, 18-, and 24-month follow-ups. Interestingly, although this pro- 
gram is considered short-term, it was the only program of the six in this 
review focused on adolescents with follow-up data suggesting a possible 
sleeper effect in program benefits. This calls into question the claim that 
long-term interventions are needed for long-lasting effects. 

What is most interesting about the Penn Prevention Project is that it 
has been implemented in a variety of in-school and out-of-school set- 
tings, including community-based organizations. It has also been evalu- 
ated repeatedly and has had good success at replication. The program 
consists primarily of training in self-management skills and social inter- 
pretative skills. The adolescents are taught new ways to cope with inter- 

O 
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personal conflict as well as new ways to interpret other people’s behav- 
iors so that they do not misinterpret social interactions as more hostile or 
demeaning than they actually are. These skills in turn are assumed to 
help the adolescent cope better with interpersonal interactions likely to 
reinforce depression and conflict. The Penn Prevention Project has ex- 
tensive program materials and. training manuals to help organizations 
implement the program based on its principles (Shatte and Reivich, no 
date). 

Do multiyear programs foster more enduring benefits than short- 
term program interventions? Four programs involving adolescents come 
close to meeting the multiyear criteria, but only two, the Improving So- 
cial Awareness-Social Problem Solving (ISA-SPS) and the Bullying Pre- 
vention Program, actually extended beyond one year. The ISA-SPS two- 
year program targeted the transition to middle school by focusing on 
changing the school culture. The social problem-solving curriculum in 
ISA-SPS has three phases. The readiness phase emphasized teaching self- 
control, group participation, and social awareness. In the instructional 
phase, teachers teach social decision-making and problem-solving strat- 
egies. In the final application phase, teachers extend the curriculum to 
real-life conflicts in which the students are helped to use problem-solving 
skills to solve their conflicts through modeling, direct instruction, and 
group discussion. In the evaluation reviewed, positive gains in the youth’s 
interpersonal behaviors (see Table 6-1 for details) were maintained for 
six years after exposure to the intervention. 

The Bullying Prevention Program, part of a national campaign 
against bullying in Norway, lasted two years. It is a school-based uni- 
versal prevention program focused on reducing bullying problems by 
increasing awareness and knowledge of the problem, involving teachers 
and parents together with adolescents in discussing these problems, es- 
tablishing clear rules against bullying behavior, and providing support 
and protection for bullying victims. In the evaluation of this program 
reviewed by Greenberg, there were decreases in bullying for the “treated” 
adolescents. The positive effects of this program were maintained at 
least through the 20-month follow-up assessment. 

The other two programs, Big Brothers Big Sisters and the School 
Transition Environmental Project, were 9 to 12 months in length. Men- 
tors in the Big Brothers Big Sisters program (described in more detail 
later in this chapter) met with their assigned child three times per month 
for three to four hours for at least one year. Treatment effects were 
found across multiple outcome measures ranging from hitting behavior 
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to academic performance (see Table 6-1 for details). Follow-up data 
have not been collected. 

The School Transitional Environmental Project focused on changing 
the school social climate to assist in the transition to middle school in 
large school systems with many feeder schools. Homeroom teachers 
were assigned to smaller cohorts to function as a liaison and guidance 
counselor. The effects of the program intervention were positive (see 
Table 6-1 for details), but no follow-up data were collected, so we know 
nothing about the stability of the effects over time. 

So, do the programs targeting adolescents, warrant the same conclu- 
sions reached by Greenberg and colleagues for the full array of programs 
included in the review? First, do multiyear preventive programs produce 
longer-term effects than short-term program interventions? Many posi- 
tive long-term effects were found in the two programs lasting longer than 
one year; however, with only two programs as examples, it would be 
unfair to conclude that multiyear programs contribute to longer-lasting 
effects than short-term programs, especially given the evidence of sus- 
tained effects from two of the short-term programs discussed earlier. 

Second, are programs targeting multiple levels and settings (i.e., in- 
dividual, school, community) more effective than programs targeting one 
domain? The programs most relevant to our age group give mixed sup- 
port for this conclusion. On one hand, the eight programs concentrating 
on individual change achieved positive postintervention effects. The two 
programs with follow-up data, the Penn Prevention Project and the Cop- 
ing with Stress Course, also showed evidence of sustained effects at fol- 
low-up assessments. Thus, programs targeting the individual can be ef- 
fective. However, it is quite likely that these programs also indirectly 
create changes in other domains, such as the family or school. On the 
other hand, the four programs targeting multiple levels also yielded posi- 
tive postintervention effects, and the three programs with follow-up data 
showed long-term effectiveness as well. 

In summary, from the 12 programs targeting youth ages 10 to 18, 
we can draw several conclusions. Short-term programs can be just as 
effective as programs lasting nine months to two years. Program inter- 
ventions concentrating on individual change can be as effective as those 
focusing on multiple domains. One program, a selected intervention, 
demonstrated evidence of a sleeper effect. The possibility of sleeper ef- 
fects underlines the importance of collecting follow-up data to ensure 
that effective programs are not being underestimated in their impact and 
to capture potential effects of programs yielding initial null results. Based 
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on these evaluations, it appears that mental disorder prevention pro- 
grams can be designed to support positive psychological and emotional 
development. By and large, the effective programs used skill-building 
instruction and extensive opportunities to practice these new skills at the 
individual level, and both social support and social norm-building strate- 
gies at the school and program level. Future evaluation research in this 
domain should focus on the causal links between program interventions 
and outcomes and on the extent to which these programs can be imple- 
mented in community settings beyond the school and the school day. Some 
clearly were. Nonetheless, these results do suggest that life skill-building 
and positive norm-setting programs can be effective when done well. 



Summary 

By and large, the program interventions designed to prevent mental 
illness can be quite effective and, when assessed, appear to have long- 
term positive consequences. Programs based on clinical theories of be- 
havior change and sound instructional practices are effective at both re- 
ducing problem behaviors and increasing a wide range of social and 
emotional competencies. In addition, interventions in the field of mental 
health promotion use high evaluation standards. All evaluations included 
in both reviews used control group comparisons, and the majority used 
random assignment. The high level of evaluation rigor obtained was 
understandably facilitated by the short-term nature of the programs, the 
integration of these programs into the school day, and the fact that pro- 
gram participation was more likely to be seen by participants as required 
rather than voluntary. Consequently, generalizabilty of the findings to 
nonschool settings is problematic. Nevertheless, there is sufficient evi- 
dence to conclude that programs such as the ones reviewed, which target 
the prevention of mental disorders, can be effective in both reducing 
problems and increasing social and emotional competencies. These pro- 
grams are appropriate for consideration in many types of community- 
based programs and organizations. 



Violence Prevention Programs 

The Center for the Study and Prevention of Violence at the Univer- 
sity of Colorado at Boulder published a series of Blueprints (Center for 
the Study and Prevention of Violence, 2000) describing program inter- 
ventions effective in preventing violence. The Blueprints series was de- 
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veloped to give practical information to communities to help them select 
a program intervention that best matched their needs and resources. Of 
the 450 delinquency, drug, and violence prevention programs the center 
reviewed, 10 met most of the following criteria: an experimental design 
with random assignment or a strong quasi-experimental design; evidence 
of a statistically significant deterrent (or marginal deterrent) effect on 
delinquency, drug use, and/or violent behavior; at least one additional 
site replication with experimental design and demonstrated effects; and 
evidence that the deterrent effect was sustained for at least one year fol- 
lowing treatment. 

Of the 10 model programs, 6 included youth ages 10 to 18 in their 
target population: Big Brothers Big Sisters, Quantum Opportunities, the 
Midwestern Prevention Project, Life Skills Training, Multisystemic 
Therapy, and the Bullying Prevention Program. The first three are de- 
scribed in detail later in this chapter; the Bullying Prevention Program 
was described earlier. The remaining two — Life Skills Training and 
Multisystemic Therapy (see Table 6-1 for more details) — are described 
below. 

The Life Skills Training program is a school-based universal preven- 
tion program designed to prevent drug use. The program intervention is 
a curriculum to teach general life skills and social resistance skills train- 
ing. 

The Multisystemic Therapy Program uses a family ecological sys- 
tems approach to help serious violent or substance-abusing juvenile of- 
fenders. The therapy focuses on getting families involved in changing 
those aspects of the youth’s setting (i.e., peers, school, family, and com- 
munity) that contribute to the problem behavior. The primary method is 
teaching effective parenting skills and helping parents overcome such 
barriers to effective parenting as drug abuse and lack of a social support 
network in the community. 

In an effort to understand the source of change across the 10 vio- 
lence prevention programs reviewed, Elliot and Tolan (1999) looked for 
evidence that change in risk or protective factors mediated change in 
violent behavior. However, the program evaluations either had not col- 
lected the necessary data to analyze the causal processes or had not re- 
ported on the analysis. Likewise, because the studies evaluated whole 
program packages rather than specific program components, it was not 
possible to determine exactly what worked in any given program. Nev- 
ertheless, these 10 programs do provide models of what can be done in 
communities to decrease rates of violence. Interestingly, most of the 
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programs involved the kinds of experiences and settings outlined in Chap- 
ter 4 as critical for promoting positive youth development. Teaching life 
skills and providing better adult social supports were common across all 
of the effective programs. Consequently, these programs are also good 
models for what can be done to promote positive development as well. 
Most actually gathered data relevant to this goal (see Table 6-1 for de- 
tails) and were effective at promoting some aspects of positive develop- 
ment as well. 



Teen Pregnancy Prevention Programs 

Kirby (1998) reviewed evaluations of primary prevention programs 
designed to reduce sexual risk-taking and teen pregnancy. These pro- 
grams met the following.criteria: published in 1980 or later; experimen- 
tal or quasi-experimental in design; a minimum sample size of 100 in 
combined experimental and control groups; targeted 12- to 18-year-olds; 
conducted in the United States or Canada; and measures of program 
impact on sexual or contraceptive behavior or pregnancy or birth rates. 

Kirby divided programs into three groups based on whether they 
focused primarily on sexual antecedents (i.e., age, gender, pubertal tim- 
ing), on nonsexual antecedents (i.e., poverty, parental education, paren- 
tal support, drug and alcohol use), or on a combination of sexual and 
nonsexual antecedents. We focused on the latter two groups because of 
their fit with our youth development framework. Youth development 
programs were further categorized as service-learning, vocational educa- 
tion and employment, and other. All three categories focused on im- 
proving education and life options as the means to reduce pregnancy and 
birth rates. 

Service-learning programs consisted of unpaid service time in the 
community as well as structured time for training, preparation, and re- 
flection. The results for such programs were equivocal. On one hand, 
Teen Outreach Program participants reported lower rates of pregnancy 
and school failure than the controls during the school year in which they 
participated in the program intervention. Similarly, a health education 
curriculum combined with service learning was effective at reducing re- 
ported sexual activity. On the other hand, although a quasi-experimen- 
tal evaluation of service-learning programs showed a short-term trend in 
reduced pregnancy rates, the result was not statistically significant and 
the trend disappeared one year later. 

Vocational education and employment programs included academic 
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education and either vocational education or actual jobs. Again the re- 
sults were equivocal. On one hand, the Youth Incentive Entitlement 
Pilot Projects was effective at reducing birth rates and increasing both 
teen employment and school enrollment. This program guaranteed part- 
time employment to youth during the school year and full-time employ- 
ment during the summer if they remained in high school. On the other 
hand, four very rigorously evaluated employment and education pro- 
grams were not effective in reducing pregnancies or birth rates. This 
evidence suggests that vocational and employment programs are not ef- 
fective in decreasing pregnancy or birth rates. 

In summary, the strongest evidence for program effectiveness using a 
youth development framework comes from the Teen Outreach Program. 
Why was this service-learning program effective while the others were 
not? We do not have an answer for this question because causal links in 
the interventions were not evaluated. Therefore, we do not know 
whether to attribute its success to the service-learning component or to 
other characteristics of the program, such as strong bonds with adults. 
Nevertheless, the program evaluations do offer promise that a youth 
development approach may provide opportunities that reduce the risk of 
teenage pregnancy. 

Furthermore, Kirby summarized the strengths and limitations of each 
evaluation based on the following methodological principles: sampling, 
random assignment, sample size, long-term follow-up, measurement of 
behavior (sexual and contraceptive behaviors), statistical analyses, pub- 
lication of results, replication, and independent evaluation. Kirby con- 
cluded that few studies abided by high standards for each principle, thus 
limiting generalizations about which specific programs or types of pro- 
grams reduce sexual risk-taking and teen pregnancy. 



Positive Youth Development Programs 
Catalano and Colleagues 

The most comprehensive review of positive youth development pro- 
gram evaluations was funded by the Department of Health and Human 
Services and compiled by Catalano, Berglund, Ryan, Lonczak, and 
Hawkins (1999). This report examined evaluations of positive youth 
development programs solicited from a wide variety of sources. The 
authors reviewed 77 program evaluations and chose 25 for their report 
(see Table 6-1 for details). Only research designs using a control or 
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strong comparison group with measures of youth behavioral outcomes 
were included. Programs had to have at least one significant effect. 5 
The programs selected had to include at least one of the following objec- 
tives identified by the authors as important for positive youth develop- 
ment: promotes bonding; fosters resilience; promotes social, emotional, 
cognitive, behavioral, and moral competence; fosters self-determination, 
spirituality, self-efficacy, a clear and positive identity, belief in the future, 
and/or prosocial norms; or provides recognition for positive behavior 
and/or opportunities for prosocial involvement. In general, these charac- 
teristics and strategies of effective positive youth development programs 
closely match the personal and social assets and features of positive de- 
velopmental settings identified in Part I as important for healthy adoles- 
cent development. 

Catalano et al. concluded that the most effective programs sought to 
strengthen social, emotional, cognitive, and behavioral competencies, 
self-efficacy, and family and community social norms for healthy social 
and individual behavior. To achieve these goals, the effective programs 
targeted a combination of social settings (family, school, church, com- 
munity, and work). Of the social settings mentioned, 88 percent had a 
school component, 60 percent had a family component, and 48 percent 
had a community component. 

Many of the positive youth development principles identified by 
Catalano et al. are closely linked to the assets and social settings identi- 
fied by the committee. Opportunities to develop competence and self- 
efficacy, as well as the inclusion' of prosocial norms (positive social 
norms in our language) were present in all 25 programs. Opportunities 
for prosocial involvement and recognition of positive behavior were pro- 
vided in 88 percent of the programs. Social bonding was promoted in 
76 percent of the programs. Explicit opportunities to develop the other 
five target assets (positive identity, self-determination, belief in the fu- 
ture, resiliency, and spirituality) were a focus for fewer than half of the 
programs. 



5 Although some may feel that the researchers erred in including only programs with 
significant results, the state of evaluation in this area is still such that it is virtually impos- 
sible to draw conclusions from nonsignificant results. Nonsignificant results could reflect 
poor program implementation, weak measures of outcomes, inadequate specification of 
what outcomes should be effected, program attrition, etc. All of these design problems 
make it very difficult to reach any conclusion about what does not work. Given this state 
of affairs, we agree with Catalano et al.’s decision not to include programs with nonsignifi- 
cant effects in their review, and we have also chosen not to report on programs that do not 
work. 
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Catalano et al. (1999) concluded that two general program strate- 
gies were evident in the most effective programs: skill building and envi- 
ronmental/organizational change. A focus on social or cognitive behav- 
ioral skills occurred in 96 percent of the programs; decision-making and 
self-management skills in 73 percent; coping skills in 62 percent; and 
refusal-resistance skills in 50 percent. Effective environmental or organi- 
zational change programs focused on influencing teacher classroom prac- 
tices and peer social norms. 

This review of youth programs was very comprehensive. Catalano 
et al. concluded that positive youth development approaches could, when 
implemented well, increase positive youth behavior outcomes and de- 
crease youth problem behaviors. In 19 of the programs reviewed, posi- 
tive changes in youth behavior included significant improvements in in- 
terpersonal skills, quality of peer and adult relationships, self-control, 
problem solving, cognition, self-efficacy, commitment to schooling, and 
academic achievement. Of the programs reviewed, 24 showed signifi- 
cant reduction in problem behaviors, including drug and alcohol use, 
school misbehavior, aggressive behavior, violence, truancy, high-risk 
sexual behavior, and smoking. 

However, Catalano et al. also noted that many of the evaluations 
themselves had limitations. Of the 25 programs meeting the inclusion 
criteria, only 64 percent used experimental designs with randomization 
and only half gathered any follow-up data. None included comprehen- 
sive information about the program, the implementation process, the 
youth development constructs being addressed, or the relation between 
the implementation information and outcomes. Also, assessment mea- 
sures were rarely adequate to track positive youth development over time, 
and problem behaviors were measured much more frequently than posi- 
tive behaviors. Consequently, much more research is needed before one 
can be confident about which programs and which aspects of these pro- 
grams actually impact youth development. Nonetheless, the findings are 
promising enough that they can be used to inform future program design 
and to make decisions about which programs are ready for more rigor- 
ous evaluation. 



Roth and Colleagues 

Roth et al. (1998a) reviewed over 60 evaluations of prevention and 
intervention programs for adolescents that incorporated positive youth 
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development program objectives. Of the 60 programs reviewed, 15 were 
selected for inclusion in the review (see Table 6-1 for details). These 15 
shared the following characteristics: a positive youth development focus, 
an experimental or quasi-experimental design, and a focus on youth not 
currently demonstrating problem behaviors. The programs were grouped 
into three categories (listed in order of how closely they matched a youth 
development framework): (a) programs focused on increasing positive 
behaviors and competencies (asset-focused programs); (b) programs fo- 
cused on both reducing problem behaviors and increasing competencies 
and assets (problem-behavior and asset-focused programs); and (c) pre- 
vention programs focused on resistance skills. 

The authors concluded that programs incorporating more elements 
of the youth development framework (a framework that seemed very 
consistent with the assets and features of settings developed in this re- 
port) showed more positive outcomes — that is, programs that focused on 
increasing more different assets and included more different types of pro- 
gram characteristics and opportunities. However, the evidence for this 
conclusion is weak, and the number of assets and features included in 
specific programs has not been systematically manipulated in such a way 
that such a conclusion is warranted at this point based on experimental 
and quasi-experimental evaluations. Like the Catalano et al. review, 
Roth and colleagues also concluded that the most effective programs 
included both caring adult-adolescent relationships and life skills devel- 
opment. In addition, the authors concluded that longer-term programs 
were more effective than short-term programs with limited goals. Again, 
however, the evidence for this is minimal. 

This review stands out because it included a framework to categorize 
youth development programs; it focused on community-based (rather 
than school-based) programs; and it insisted on rigorous standards of 
evaluation before concluding that a program was effective. Thus it pro- 
vides quite comprehensive evidence that community programs focused 
on youth development can be effective. 

Unfortunately these evaluations still did not reveal much about ei- 
ther the long-term effects or the generalizability of these programs. There 
was also no insight about which specific aspects of the programs were 
most effective for any particular outcome or population group. None- 
theless, they do provide useful information about promising programs 
that should be considered for replication and for more intensive evalua- 
tion. 
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Hattie and Colleagues 

Hattie and colleagues (1997) performed a meta-analysis of the ef- 
fects of adventure programs drawn from extensive database searches. 
These searches yielded 96 evaluations of adventure programs meeting 
the inclusion criteria for the review. The authors used sample size, the 
presence of control groups, methodological descriptions, and instrument 
quality to rate the evaluations as low, medium, or high in quality. Nine 
studies were excluded based on the four authors’ agreement on their 
poor quality and because their means were so different from the other 
studies. School-based outdoor education program evaluations were also 
excluded because of a typically shorter duration, nonchallenging experi- 
ences (relative to other adventure programs), and evaluation results that 
differed from the more challenging programs. 

Although adventure education programs do not usually take place in 
the communities from which the youth are being recruited and the evalu- 
ations of these programs suffer from the same methodological problems 
encountered in the previous reviews, we include the findings from this 
review because effective adventure programs can suggest potential pro- 
gram components important for healthy development. Adventure pro- 
grams also typically include features of positive developmental settings 
outlined in Part I. Common features of adventure programs include 
wilderness or backcountry settings, groups of less than 16, mentally and 
physically challenging experiences, intense social interactions often relat- 
ing to group problem solving and decision making, trained nondirective 
leaders, and an average duration of two to four weeks. 

Hattie et al. concluded that short-term positive effects were main- 
tained and sometimes even increased over time. More specifically, the 
authors concluded that adventure programs have significant effects on 
the kinds of psychological, emotional, and cognitive assets discussed in 
Chapter 3 — such as self-control, confidence in one’s abilities to be effec- 
tive, good decision making, improved school achievement, leadership, 
independence, assertiveness, emotional stability, social comparison, time 
management, and flexibility. 
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General Conclusions 

Positive Development Framework 

° Two program components emerged as important across all re- 
views: service learning and mentoring. Service learning was a 
particularly crucial program component for youth ages 15 to 18. 

° The vast majority of programs reviewed were school-based and 
included young people of all ages. Whether such programs can be 
successfully implemented in a more voluntary setting (e.g., during 
nonschool hours and in out-of-school settings) is not clear. 

° There is little overlap between the measures collected in most of 
the evaluations summarized in these reports and the framework 
for positive adolescent development outlined in Part I. In part 
this reflects the fact that these studies were not designed to assess 
the features in this framework. But it might also suggest a scar- 
city of well-validated measures of personal and social assets and 
features of positive developmental settings (see Chapter 8 for more 
discussion of this issue). In part it also likely reflects the discon- 
nection between research and practice traditions and points to the 
need for more collaborative efforts involving the research, prac- 
tice, and policy communities in both designing and evaluating 
community programs for youth. 

9 Most evaluation studies show modest short-term effects; some 
show longer-term effects, but follow-up data are rare and, when 
collected, rarely cover a period of more than two years after the 
program end. In general, follow-up studies tend to show smaller 
effects over time. 



The Quality of Evaluation 

0 Most of the evaluations conducted in school-based programs in- 
cluded in this review met high technical standards for assessing 
effectiveness for individual children. However, these programs 
focused more on preventing negative outcomes than on fostering 
positive development. 

® Evaluations of more voluntary community-based programs are 
still less rigorous than the evaluations of school-based prevention 
programs. Possible reasons for this discrepancy are discussed in 
Chapter 7. 
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° Few evaluations are comprehensive. That is, they do not have: an 
analysis of program theory, quality information about implemen- 
tation, quality information about effectiveness, quality analysis of 
why effects did or did not come about, an analysis of the 
replicability of the program, or an analysis of how important the 
program is and why. 

THREE MODEL PROGRAM EVALUATIONS 

Three programs — the Teen Outreach Program, Quantum Opportu- 
nities, and Big Brothers Big Sisters — stand out among the programs in- 
cluded in the meta-analyses and reviews just summarized for several rea- 
sons. First, these programs are consistent with the youth development 
framework laid out in Part I. Second, these programs illustrate that 
high-quality experimental evaluation can be done with community pro- 
grams for youth. These three programs also reflect different program 
delivery mechanisms. Big Brothers Big Sisters and Quantum Opportuni- 
ties Program are offered by community agencies, while the Teen Out- 
reach Program has community components but is managed by schools. 
We now describe these in more detail because there is sufficient evidence 
that they can be used a promising models for the design of new youth 
programs. 



Teen Outreach Program 



Evaluators: 

Level of intervention: 
Target population: 
Evaluation research design: 
Sample: 

Attrition analysis: 



Cost: 



J.P. Allen et al. (1997) 

Multilevel (community, school) 

9th- 12th grade students 
Experimental with random assignment 
695 (342 experimental, 353 control) 
Dropped out of program prior to 
evaluation: 5.3 percent experimental; 
8.4 percent control 
$500-700/student/academic year for 
class of 18-25 students 



The Teen Outreach Program is a widely replicated program that in- 
volves both a school-based discussion curriculum focused on life skills, 
parent-adolescent communication, and future life planning and an inten- 
sive volunteer service experience. Although it was designed to prevent 
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adolescent problem behaviors by promoting healthy social development 
in high school students, it focuses very little attention directly on sexual 
behavior and reproduction. The evaluation focused on three problem 
behaviors: teenage pregnancy, school suspension, and school failure. The 
program was designed to help adolescents understand and evaluate their 
future life options and develop life skills and autonomy in a setting that 
creates strong social ties to adult mentors. To accomplish these goals, 
three components were designed: supervised community service, class- 
room-based discussions of service experiences, and classroom-based dis- 
cussion and activities related to social-developmental tasks of adoles- 
cence. The cost of offering the program to a class of 18 to 25 for an 
academic year is $500 to 700 per student, when both facilitator and site 
coordinator time is included in the cost. When staff time is provided as 
an in-kind contribution by a school and a community service organiza- 
tion, the direct costs of the program drop to under $100 per student. 

Each adolescent participated in an intensive volunteer activity (drawn 
from a wide range of such opportunities) coordinated by trained staff 
working in cooperation with local community organizations. The activ- 
ity was chosen by the participant with the help of trained staff who as- 
sisted by matching the individual’s interests with community needs. 
Examples of activities included working as aides in hospitals and nursing 
homes, participating in walkathons, and peer tutoring. The program 
sites were required to provide a minimum of 20 hours per year of volun- 
teer service for each participant. Participants averaged 45.8 hours of 
volunteer service during their 9 months of involvement. 

Classroom discussions occurred at least once weekly throughout the 
academic year; trained facilitators, usually teachers or guidance person- 
nel, led them. The Teen Outreach Curriculum created the framework 
for such activities as structured discussions, group exercises, role plays, 
guest speakers, and informational presentations. Discussions were de- 
signed to help students prepare for, and learn from, their service experi- 
ences by dealing with such topics as lack of self-confidence, social skills, 
assertiveness, and self-discipline. Discussions also focused on such de- 
velopmental topics as values clarification, managing family relationships, 
and handling close relationships. 

The program focused very little explicit attention on the three target 
problem behavior outcomes. For example, less than 15 percent of the 
“official” curriculum dealt with sexuality, and even these materials were 
often not used, either because they overlapped with similar information 
being offered in the school or were in conflict with community values. 
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Evaluation Design and Results 

Because the program had showed promise in previous nonexpert 
mental studies (Allen et ah, 1990; Philliber and Allen, 1998) with high 
school students, program developers submitted the program to a rigor- 
ous evaluation. In this evaluation, 695 high school students in 25 schools 
nationwide were randomly assigned to either the intervention or a con- 
trol group at either the student level or the classroom level. Student-level 
assignment was used when there were more students wanting the class 
than there were slots. In this case, students were randomly assigned to 
get the class or be assigned to a wait list for the following year. Class- 
room assignment was used when the school preferred to include the pro- 
gram in already existing courses. In this case, it was randomly decided 
which course would be involved in the program and which would not; 
students did not select the class knowing it was going to be involved in 
the program. Baseline data were gathered at the start of the program; 
posttest data were gathered nine months later at the end of the program. 
Data were collected during the 1991-1995 school years. (A subsequent 
additional evaluation has been completed but the results are not yet avail- 
able). After controlling for initial experimental and control group 
nonequivalence on the outcome measures, fewer youth in the experimen- 
tal group were suspended, failed courses, or became pregnant than stu- 
dents in the control groups. 

Strengths and Limitations 

Some aspects of the evaluation of Teen Outreach Program are exem- 
plary. Initial nonexperimental evaluations of the program (Allen et al., 
1990, 1994) indicated that it was very promising. The next logical step 
for a nationally distributed well-developed program showing promise 
was to evaluate it using the most rigorous evaluation method — an ex- 
perimental design with random assignment. Great care was taken to 
assess dosage. Two indicators of dosage were included in the analysis: 
the number of classroom sessions attended and the number of hours of 
volunteer service. There were no significant dosage effects for either 
indicator on the prediction of pregnancy or academic suspension. How- 
ever, a significant dosage effect was found for the relation between the 
number of volunteer hours and course failure: students who performed 
more volunteer service were at lower risk for course failure during the 
program. Consequently, the positive effects produced by the evaluation 



ERIC 




184 



Community Programs to Promote Youth Development 



using 25 different sites gives a high degree of confidence that the pro- 
gram effects are generalizable. 

However, neither the program design nor the evaluation was explic- 
itly guided by an elaborated theory of change. In addition, only a limited 
range of outcomes was assessed, and little information was gathered 
about the quality of the implementation. Finally, no follow-up data were 
collected to assess how sustained the effects were. 

In conclusion, the essentials of the program are well based in re- 
search, but the evaluation did not have a well-articulated theory of 
change. The evaluation research showed that the program reduced teen- 
age pregnancies, school failure, and academic suspensions. It is espe- 
cially effective with adolescents who need the program the most — at-risk 
youth. While no single study is beyond criticism, the technical quality of 
evaluation research on this program has steadily improved with each 
study, and no common bias runs throughout the entire program of stud- 
ies. So replication and generalizability are not a problem. Dosage effects 
were included in the evaluation analyses. There is some evidence that 
more frequent participation in the program relates to outcomes, although 
there are selection issues. No fine-grained analyses were done to deter- 
mine which program components were responsible for the effect. 



Quantum Opportunities Program 



Evaluators: 

Level of intervention: 
Target population: 

Evaluation research design: 

Sample: 

Attrition analysis: 



Cost: 



Hahn, Leavitt, and Aaron (1994) 
Multi-level (community, school, work) 
9th-12th grade students receiving 
public assistance 

Experimental with random selection 
and assignment 

50 students (25 intervention, 25 
control) at 5 sites 

88 of the 100 program participants; 
82 of 100 control participants were 
interviewed in the follow-up 
evaluation. 

$ 10,600/student for 4 years; $2,650/ 
student/year 



The Quantum Opportunities Program was designed to serve very 
poor adolescents living in high-risk neighborhoods by providing educa- 
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tion, community service, and development activities, as well as financial 
incentives, from 9th grade through high school graduation. Adolescents 
from families receiving public assistance entered the program in the 9th 
grade and continued for four years through high school. 

It is a community-based, year-round, multiyear, and multilevel youth 
development program. Each participant was eligible to receive the fol- 
lowing experiences each year: 

° 250 hours of education activities, such as participating in com- 
puter-assisted instruction, peer tutoring, etc., with the goal of 
enhancing basic academic skills; 

® 250 hours of developmental activities, including participating in 
cultural enrichment and personal development, acquiring life/ 
family skills, planning for college or advanced technical/vocational 
training, and job preparation; and 

® 250 hours of service activities, such as participating in community 
service projects, helping with public events, and working as a vol- 
unteer in various agencies. 

Financial incentives were built into the project design. Staff and 
agencies received payments based on student participation numbers. 
Participants themselves received small hourly stipends ($1 increasing to 
$1.33) for participation, a $100 bonus, and $100 for college or training 
funds after completing 100 hours of programming. 



Evaluation Design and Results 

Participants were randomly selected from lists of 8th grade students 
from families receiving public assistance. The students were then re- 
cruited and randomly assigned to the experimental or control group. At 
the end of 9th grade, test scores declined for the intervention group and 
there were no significant differences in education expectations between 
the intervention and the control group. After two years — the end of 10th 
grade — academic and functional skill scores increased and exceeded con- 
trol group participants in five areas. At the end of senior year, perfor- 
mance in all 11 academic and functional skill areas was greater for the 
intervention group than the control group. About 6 months after sched- 
uled high school graduation, the intervention group showed benefits from 
the program in several areas. 
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Strengths and Limitations 

Like the Teen Outreach Program evaluation, this evaluation was 
excellent in many ways. However, it also had limitations. First, a sub- 
stantive theory of change was not explicitly stated and mediating causal 
processes were not investigated. Nonetheless, the program was designed 
with some attention to theory and explicit cause and effect relations: for 
example, it emphasized the importance of community through the ser- 
vice component; it taught responsibility through the program require- 
ments; it provided opportunity through the rich set of offerings; it taught 
investment skills through earned stipends and college savings; it stressed 
the importance of meaningful adult relationships throughout the high 
school years; and finally, it recognized the importance of continuity 
across time by creating a four-year program. Each of these program 
design components is compatible with the committee’s list of features of 
positive developmental settings. 

The multiple components of the program produced multiple positive 
effects using a strong pre- and postexperimental design. Youth were not 
only randomly assigned to the program intervention and control groups, 
but they were also randomly selected prior to program recruitment. The 
positive effects of this study are particularly impressive considering the 
frequent difficulties in recruitment and retention of youth ages 15 to 18. 
The program was well implemented according to evidence of participa- 
tion and retention rates, although there was no specific information re- 
garding the quality of program activities. The theory behind the pro- 
gram was not well articulated in the evaluation design. Consequently, 
most of the goals proposed in the program design phase were not evalu- 
ated. 

In summary, this program seems very promising and is grounded in 
research on the importance of service learning and mentoring. In gen- 
eral, the program effects look positive; however, there is no explicit 
theory of change. Consequently, we know little about why and for whom 
it worked. Like the Teen Outreach Program, the program offers a ser- 
vice-learning component for young people having difficulties in school. 
The program also has a mentoring component that the staff thinks is 
critical for positive results. The evaluation study was relatively small 
(100 youth from 4 cities in the intervention). Finally, the program is 
quite expensive. The extent to which the payments to the youth are 
essential has not been assessed. 
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Evaluators: 

Level of intervention: 
Target population: 
Evaluation research design: 

Sample: 

Attrition analysis: 

Cost: 



Grossman and Tierney, 1998 
Community and individual 
10- to 16-year-olds 
Experimental design with random 
selection and assignment 
1,138 (571treatment, 567 control) 

487 of the 571 treatment participants; 
472 of the 567 control participants 
Average of $1, 543/match/year 



Big Brothers Big Sisters is a community-based mentoring program 
that matches an adult volunteer, known as a Big Brother or a Big Sister, 
to a child, known as a Little Brother or Little Sister, with the expectation 
that a caring and supportive relationship will develop. The match is well 
supported by mentor training and ongoing supervision and monitoring 
of the mentor relationship by a professional staff member. Ideally, the 
matched pair spends three to five hours per week together over the course 
of a year or longer. The activity goals are identified in the initial inter- 
view held with the parent or guardian and the child. The top priority is 
for the matched pair to develop a relationship that is mutually satisfying 
and provides contact on a regular basis. The goals established for a 
specific match are developed into an individualized case plan, which is 
updated by the case manager as progress is made and circumstances 
change over time. The case manager is responsible for maintaining con- 
tact with all parties in the match relationship. 

In order to ensure effective matches between volunteers and youth 
and to monitor program quality, the professional staff screens all appli- 
cants, youth, and their families. Orientations are conducted with youth 
and volunteers, and training is provided for volunteers. Staff supervises 
matches between youth and volunteers by contacting all parties within 
two weeks of the initial match and then having monthly telephone con- 
tact with the volunteer for the first year of the program. The staff also 
contacts the youth directly at least four times in the first year. 



Evaluation Design and Results 

An experimental design using random assignment was used to evalu- 
ate the Big Brothers Big Sisters program at eight program sites: Phoenix, 
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Wichita, Minneapolis, Rochester, Columbus, Philadelphia, Houston, and 
San Antonio. Youth ages 10 to 16 who came to the agencies during the 
study period, October 1991 to February 1993, were randomly assigned 
to either the mentoring or the control group. Baseline data were col- 
lected, treatment subjects were matched with a mentor when possible, 
and control subjects were placed on a waiting list for 18 months. Pre- 
and posttreatment data consisted of self-assessment questionnaires on 
family background information and outcome variables. The evaluation 
sample consisted of 959 10- to 16-year-olds (487 treatment, 472 con- 
trols) from single-parent households. At pretest, 69 percent were be- 
tween the ages of 11 and 13; 43.3 percent lived in households receiving 
public assistance; 27.1 percent were experiencing physical, emotional, or 
sexual abuse; 23 percent were minority girls, 15 percent were white girls, 
34 percent were minority boys, and 28 percent were white boys. 

Matches were found for 378 (78 percent) of the 487 members of the 
treatment group; 109 of the treatment group were not matched. The 
evaluators suggested three main reasons for the failure to match the 109 
treatment youth: (1) 33 became ineligible for the program because their 
parent remarried, the youth became too old, or the residence of the youth 
changed; (2) 31 because the youth no longer wanted to participate; and 
(3) 21 because the staff couldn’t find a suitable volunteer mentor. The 
other 24 were not matched for a variety of reasons such as parent or 
youth not following through on the intake process. 

Youth in the treatment group (including both those who received a 
mentor and those who did not) were less likely to initiate drug and alco- 
hol use than the waiting list youth; they also reported hitting others less 
often. Their grade point average was higher, and they attended school 
more often. Finally they also reported better parental relationships and 
more parental trust. 



Strengths and Limitations 

The Big Brothers Big Sisters program is a very promising program 
based on the multiple benefits to youth of being mentored by nonfamilial 
adults. The random assignment evaluation design meets high standards. 
One major weakness, however, is the total reliance on self-reporting by 
the youth for the outcome measures. Another is the failure to include 
implementation or process analysis. As a result, we really know little 
about why the average-level effects are obtained and why the program 
may have worked very well for some youth and not at all for others. A 
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good qualitative evaluation component would have provided prelimi- 
nary answers to these questions, and such an evaluation is now under 
way. A third weakness is the failure to gather follow-up data. Thus we 
know nothing about the length of positive impact. Finally, because Big 
Brothers Big Sisters does not have an explicit theory of change — the 
analysis of implementation quality does not go beyond descriptions of 
the number of contacts between mentor and young person and beyond 
their reports of satisfaction with the relationship. And with regard to 
this measure, many pairs did not meet as often as recommended by the 
program. A much more detailed study of implementation is now under 
way. 

Three other aspects of the evaluation need to be noted. First, the 
treatment group included some youth who were assigned to receive the 
program intervention but were never matched; thus the analyses may 
underestimate the effect size. Second, outcome effects were reported 
using relative rather than absolute percentages, thereby possibly inflating 
effect sizes. 

In summary, Big Brothers Big Sisters is a very promising community 
program for youth. The program is grounded in the research showing 
that positive relationships with nonfamilial adults support positive de- 
velopment. The researchers included all youth assigned to the treatment 
when they estimated the effects of the program. This procedure is likely 
to underestimate the impact of the program on those who actually re- 
ceived the services. Nonetheless, the program yielded significant positive 
benefits on multiple fronts. The evaluation was exemplary in some ways 
and limited in others. A strong methodological design with random as- 
signment was used to evaluate the program. However, one could be 
more confident about the results if there were long-term follow-up data, 
the analysis included site-level as well as individual-level information, 
and more was known about the characteristics of each of the eight sites. 



The committee was very interested in understanding why programs 
are effective and particularly how and why they are effective in promot- 
ing adolescent development. The quality of information in most studies 
about the particular features of effectiveness, however, was minimal. 
Furthermore, these studies were not necessarily designed to collect infor- 
mation about those aspects of adolescent development outlined in this 
report. However, we read the descriptions of these studies carefully for 
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clues as to why they might have worked and how they were related to the 
elements of the development framework we hypothesized as being im- 
portant at the beginning of this report. Each program, in fact, included 
several components that were consistent with this framework. We 
learned that many programs can effectively promote healthy develop- 
ment, although we learned much less about why. Without such informa- 
tion, we cannot say very much about which particular components or 
combination of components were responsible for the programs’ effec- 
tiveness. We therefore cannot draw firm conclusions about which and 
how many of the features of settings in Chapter 4 were critical for the 
success of these programs. Nevertheless, in this section we attempt to 
compare these programs with our framework. 

It is important to keep in mind that we imposed our list of setting 
features onto programs that were not designed with this particular frame- 
work in mind; we therefore had to rely on our interpretation of the pro- 
gram descriptions and other information provided in the evaluation 
materials to infer whether a program offered a particular feature or not. 



Supportive Relationships 

Supportive relationships were a major component of most of the 
effective programs reviewed. Explicit mentoring activities are the most 
obvious examples of nurturing supportive relationships, but most of the 
programs provided youth with some form of regular supportive contact 
with nonfamilial adults. In many cases, mentoring was not explicitly 
stated as a program goal, but the adult-adolescent contact in these pro- 
grams often took the form of mentoring. For example, Quantum Op- 
portunities used an intensive case management approach to tailor their 
program to meet individual needs and circumstances. This approach 
required regular supportive interactions between the case manager and 
the adolescent. In addition, many of the programs officially designated 
mentoring as the central component of the program. The best example 
of this is Big Brothers Big Sisters. The positive effects of mentoring were 
clearly documented in the evaluation of this program. Follow-up was 
done to understand the factors contributing to supportive mentoring re- 
lationships. Through telephone interviews with 1,1.01 mentors in 98 
mentoring programs and through youth focus groups and youth inter- 
view data (Herrera et al., 2000), the evaluators found that mentors with 
the closest and most supportive relationships reported more than 10 
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hours of contact per month, shared interests between the mentor and 
youth, and shared decision making about activities. 



Opportunities to Belong 

Healthy development is promoted by fostering a sense of belonging, 
an area which the Quantum Opportunities Program stressed. Instilling a 
sense of belonging was at the core of its mission as reflected in their 
motto, “Once in QOP, always in QOP.” If participants stopped attend- 
ing activities and disappeared from the program, program staff tracked 
them down to find out what was wrong, to assure them they were still 
part of their QOP “family,” and to coax them back to the program. This 
attitude of refusing to give up on youth was considered by Hahn et al. 
(1994) to be a crucial component of the program. Although this out- 
reach might have been seen as coercive, evidence from the student evalu- 
ations of the program suggest that this was not the case: for three of the 
four sites evaluated, 78-92 percent of the students thought the program 
was “very important” and 82-92 percent were “very satisfied” with the 
program. It is unlikely that students would give these responses if they 
felt coerced to attend or hassled by unwanted adult attention. 



Positive Social Norms 

Even when not explicitly stated as a program goal, all of these pro- 
grams promoted positive social norms and discouraged norms related to 
the major problem behaviors of concern in these programs. Programs 
with a community service component — Quantum Opportunities and the 
Teen Outreach Program — best exemplify this feature. Youth partici- 
pants were matched with an adult mentor and received classroom-based 
social problem-solving skills training and participated in community ser- 
vice activities with their mentors. The discussions in school were explic- 
itly designed to support positive social norms among the students partici- 
pating. In many cases, parents also participated in workshops, to 
enhance their ability to help their children maintain positive social norms 
and reject antisocial norms and pressures from peers to participate in 
problem behaviors. Programs that taught resistance skills also exemplify 
this feature. 
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Support for Efficacy and Mattering 

Providing opportunities for autonomy, taking responsibility, and 
challenge are likely to be especially important for older adolescents as 
they approach the transition to adulthood. Most of the programs re- 
viewed in this chapter did not address opportunities for developing a 
sense of efficacy. More such programs were reviewed in Chapter 5. 
However, programs with a focus on skill acquisition, such as the Penn 
Prevention Program, do exemplify this characteristic because such learn- 
ing opportunities, if implemented as discussed in Chapter 4, are the best 
settings in which to acquire a strong sense of personal efficacy. We talk 
more about this in the next section. Support for mattering was more 
clearly evident in the effective programs reviewed in this chapter. This 
feature was most evident in programs that provided opportunities to 
participate in community service. Two of the model programs, Quan- 
tum Opportunities and the Teen Outreach Program, were successful in 
involving high school students in community service, life and family skills 
training, and support in planning for college and jobs. 



Opportunities for Skill Building 

Opportunities for skill building were plentiful in the programs re- 
viewed. An emphasis on social skills was a frequent program goal. Build- 
ing skills in resisting peer influences to engage in a wide range of prob- 
lem behaviors (such as unprotected sex, drinking and drug use, and illegal 
behaviors) was common in programs primarily focused on preventing 
such problems as drug and alcohol use, teen pregnancy, and HIV/AIDS 
(see program descriptions in Table 6-1 for ENABL, Life Skills Training, 
Project ALERT, Positive Youth Development Program). Also, many of 
the programs focusing specifically on the parent-youth relationship in- 
clude activities to teach youth and parents better communication skills 
(e.g., the Adolescent Transitions Project, Creating Lasting Connections, 
Functional Family Therapy, Improving Social Awareness-Social Prob- 
lem Solving, the Midwestern Prevention Project, the Social Competence 
Program for Young Adolescents, the Teen Outreach Program). 

Other programs focus on individual cognitive, social, and emotional 
skill development. Some focus on such social and emotional skills as 
coping and self-regulation (Coping with Stress Course, Functional Fam- 
ily Therapy, the Penn Prevention Project). Others provided employment 
or economic management skills through part-time employment with 



Lessons from Experimental Evaluations 



193 



mentoring, encouragement for opening savings accounts, and financial 
incentives for participation (Quantum Opportunities, the Summer Train- 
ing and Education Program, Louisiana State Youth Opportunities). 

Integration of Family, School, and Community Efforts 

Several programs excelled in integrating family, school, and commu- 
nity into their program design. The Midwestern Prevention Project in- 
cludes a set of program activities to prevent adolescent drug use: (1) mass 
media programming with news clips, commercials, and talk show discus- 
sions on drug use incorporated with information on their program; (2) a 
school-based program teaching resistance and counteraction skills for 
drug use; and (3) parent education and organizing. 

Project Northland also used a community-wide approach. Students 
received skills training to enhance their social competency in dealing with 
their parents, their peers, and the norms surrounding alcohol use. Parent 
education and involvement was also stressed through parent-student 
homework activities and through newsletters to parents containing edu- 
cational information. Community-level changes in alcohol-related pro- 
grams and policies were also targeted. Finally, the Valued Youth Part- 
nership Program participants were given training in how to tutor and 
then engaged in tutoring of younger students for at least four hours per 
week. Parents were involved in school activities, and students were ex- 
posed to role models in the community through presentations and field 
trips. 



Structure and Safety 

These two characteristics of positive developmental settings from our 
list — appropriate structure and physical and psychological safety — re- 
ceived little mention in the program descriptions. Perhaps this omission 
reflects that fact that these characteristics are considered so basic that 
they are not worthy of explicit mention. One of the fundamental reasons 
for community programming for youth is to provide safe places for them 
to go. Wisdom would dictate then that programs must enable youth to 
feel and be psychologically and physically safe. To do this, programs 
need to have clear and consistent rules, expectations, and boundaries. 
Nevertheless, the absence of these features is likely to be a major reason 
why programs fail and why some programs produce negative results. 
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None of the programs included in this chapter dealt explicitly with the 
use of developmental appropriate levels of structure. Some of those re- 
viewed in Chapter 5 did. These programs provided more opportunities 
for self-monitoring and active participation in rule making and enforce- 
ment as the youth matured. 



SUMMARY 

Our review of experimental and quasi-experimental evaluations of 
community programs for youth ages 10 to 18 leads to several general 
conclusions about these programs and the evaluation of these programs. 

Community programs for youth, whether they are packaged in teen 
pregnancy prevention programs, mental health programs, or youth de- 
velopment programs, can facilitate positive outcomes for youth. This 
review of experimental and quasi-experimental evaluation of community 
programs for youth revealed that participation is associated with in- 
creases in such outcomes as motivation, academic performance, self-es- 
teem, problem-solving abilities, positive health decisions, interpersonal 
skills, and parent-child relationships, as well as decreases in alcohol and 
tobacco use, depressive symptoms, weapon-carrying, and violent behav- 
ior. Although many of these studies were not designed around a positive 
youth development framework, many of the evaluations in fact included 
measures that reflected the personal and social assets and features of 
settings developed in this report. 

Even with the most rigorous methods of evaluations, there is limited 
evidence that measures the impact of these experiences on the develop- 
ment of young people and therefore limited evidence on why program 
effects are or are not obtained from the evaluations reviewed. Some of 
these studies explicitly involved components consistent with the develop- 
mental framework outlined in Part I. However, without appropriate 
information, we cannot say very much about which particular compo- 
nents or combination of components were responsible for a specific 
program’s effectiveness. Consequently, research is needed to sharpen the 
conceptualization of features of community programs and to explore 
whether other key features should be added to the list. This work should 
focus on how different populations are affected by different program 
components and features (e.g., age, gender, socioeconomic status, 
ethnicity, community environment, developmental readiness, personal- 
ity, sexual orientation, skill levels). It should also focus on how to incor- 
porate these features into community programs and on how to maintain' 
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them once they are in place. Finally, such research should identify pro- 
gram strategies, resource needs, and approaches to staff training and 
retention that can cultivate and support the features of positive develop- 
mental settings in community programs for youth. 

Also, it is our view that evaluations designed with some of the prin- 
ciples outlined in the next chapter will tell us much more about why 
particular programs work and for whom they are likely to be most effec- 
tive. And new programs can be designed with some of the principles 
outlined in earlier chapters. If such programs are designed from the 
beginning with a well-articulated theory of change grounded in solid 
developmental theory and research, we will learn a lot more about what 
programs might do to facilitate positive youth development and to pre- 
vent problems from emerging, 
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As more funding becomes available for community programs de- 
signed to promote youth development, higher expectations are being 
placed on programs to demonstrate (and not just to proclaim) that they 
do indeed promote the healthy development of youth. Well-established 
programs that draw on public funds are being adopted in cities and com- 
munities throughout the United States. Increasingly, these programs are 
being expected to demonstrate that they actually do make a difference in 
young people’s lives. It is precisely because these programs are being 
established in a wide variety of communities that it is important to know 
if they make a difference and, if so, under what conditions and for whom. 
Moreover, given the recent call for significant investments in public re- 
sources, it would betray public trust not to document the steps taken to 
implement these programs and to provide evidence of the effectiveness of 
programs. 

How should one think about evaluation of community programs for 
youth in the future? What social indicators exist that help us understand 
community programs for youth? What else is needed in order to better 
understand and evaluate these programs? 

Part III explores the various methods and tools available to evaluate 
these programs, including experimental, quasi-experimental, and non- 
experimental methods. Each method involves different data collection 
techniques, and each affords a different degree of causal inference — that 
is, whether a particular variable or treatment actually causes changes in 
outcomes. Findings from evaluations using these methods were incorpo- 
rated into Part II. We turn now to exploring evaluation methodologies 
in more detail, looking specifically at the role for evaluation (Chapter 7) 
and data collection (Chapter 8) for the future of these programs. 

There are particular challenges inherent to evaluating community 
programs for youth. Many of them tend to be relatively new and are 
continually changing in response to growing interest and investments on 
the part of foundations and federal, state, and local policy makers. In 
addition, the elements of community programs for youth rarely remain 
stable and consistent over time, given that program staff are always try- 
ing to improve the services and the manner in which they are delivered. 
Moreover, some programs struggle to overcome barriers during the 
implementation phase — for example, to receive a license or permits, to 
acquire appropriate space or renovate a facility, or to recruit appropriate 
staff and program participants. As a result, early implementation of 
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programs may not follow the specific plan. Evaluation involves asking 
many questions and often requires an eclectic array of methods. Decid- 
ing what questions to ask and the methods to use for the development of 
a comprehensive evaluation is important to the wide range of stakehold- 
ers of community programs for youth. 
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Generating New Information 




1 his chapter explores the role of program evaluation in gen- 
erating new information about community programs for 
youth. Evaluation and ongoing program study can pro- 
vide important insights to inform program decisions. For 
example, evaluation can be used to ensure that programs 
are acceptable, assessable, developmentally appropriate, 
and culturally relevant according to the needs of the popu- 
lation being served. The desire to conduct high-quality 
evaluation can help program staff clarify their objectives 
and decide which types of evidence will be most useful in 
determining if these objectives have been met. Ongoing 
program study and evaluation can also be used by pro- 
gram staff, program users, and funders to track program 
objectives; this is typically done by establishing a system 
for ongoing data collection that measures the extent to 
which various aspects of the programs are being delivered, 
how are they delivered, who is providing these services, 
and who is receiving them. In some circles, this is referred 
to as reflective practice. Such information can provide very 
useful information to program staff to help them make 
changes to improve program effectiveness. And finally, 
program evaluation can test new or very well-developed 
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program designs by assessing the immediate, observable results of the 
program outcomes and benefits associated with participation in the pro- 
gram. Such summative evaluation can be done in conjunction with strong 
theory-based evaluation (see later discussion) or as a more preliminary 
assessment of the potential usefulness of novel programs and quite com- 
plex social experiments in which there is no well-specified theory of 
change. 1 An example of the latter is the Move to Opportunity pro- 
grams, in which poor families were randomly assigned to new housing in 
an entirely new neighborhood. In other words, program evaluation and 
study can help foster accountability, determine whether programs make 
a difference, and provide staff with the information they need to improve 
service delivery. They can generate new information about community 
programs for youth and the population these programs serve and help 
stakeholders know how to best support the growth and development of 
programs. 

Different types of evaluation are used according to the specific ques- 
tions to be addressed by evaluation. In general, there are two different 
types of evaluations relevant to this report: 

1. Process evaluation (formative evaluation) describes and assesses 
how a program operates, the services it delivers, and the activities 
it carries out and 

2. Outcome evaluation (summative evaluation) identifies the results 
of a program’s efforts and considers what difference the program 
made to the young people after participating. 

These two evaluative approaches can be thought of as a set of assessment 
options that build on one another, allowing program staff to increase 
their knowledge about the activities that they undertake as they incorpo- 



1 Summative evaluations can be used with such programs to assess impact and estimate 
its size. Such evaluations are often called for when the government has invested very large 
sums of money in a novel omnibus social experiment, such as those linked to recent wel- 
fare-to-work reform or large-scale school reform efforts. Often such evaluation focus only 
on outcome differences between the treatment and the control groups. However, without 
some theory of change and measures of the processes assumed to mediate the impact of the 
program, such evaluation leave many questions unanswered and do not provide good guid- 
ance for either modifying or replicating the program in the future. We do not discuss such 
evaluations in any detail in this report. Interested readers are encouraged to look at the 
more standard textbooks on program evaluation for additional information, such as 
Shadish et al. (2001). 
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(Sox 7-1 

[Process and Outcome Evaluation 



Process evaluation helps explain how a program works and its strengths 
and weaknesses, often focusing on program implementation. It may, for 
example, document what actually transpires in a program and how closely it 
resembles the program’s goals. Process evaluation is also used to document 
changes in the overall program and the manner in which services are deliv- 
ered over time. For example, a program administrator might observe that 
attendance at a particular activity targeted to both youth and their parents 
is low. After sitting down and talking with staff, the program administrator 
discovers that the activity has not been sufficiently advertised to the parents 
of the youth participating in the program. Moreover, the project team 
realizes that the times in which the activity is scheduled are inconvenient for 
parents. Increased and targeted outreach to parents and a change in the day 
and time of the activity result in increased attendance. Thus, process evalu- 
ation is an important aspect of any evaluation, because it can be used to 
monitor program activities and help program staff to make decisions as 
needed. 

Outcome eva/uatfori facilitates asking if a program is actually producing 
changes on the outcomes believed to be associated with the program’s de- 
sign. For example, does participation in an after-school program designed 
to improve social and communication skills actual lead to increased engage- 
ment with peers and participation in program activities? Are the partici- 
pants more likely to take on leadership roles and participate in planning 
program activities than they were before participating? 



rate more options or activities into their evaluation (see Box 7-1 for 
elaboration). They can also serve as the foundation from which pro- 
grams justify the allocation of public and private resources. 

Process and outcome evaluations both rely on the collection of two 
types of data — qualitative and quantitative data (see Box 7-2 for elabo- 
ration). Quantitative data refer to numeric-based information, such as 
descriptive statistics that can be measured, compared, and analyzed. 
Qualitative data refer to attributes that have labels or names rather than 
numbers; they tend to rely on words and narrative and are commonly 
used to describe program services and characterize what people “say” 
about the programs. 
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Box 7-2 

Quantitative and Qualitative Data 

Quantitative data are commonly used to compare outcomes that may 
be associated with an intervention or service program for two different 
populations (i.e., those who received the service — or participated in the 
program — and those who did not) or from a single population but at mul- 
tiple time points (e.g., before, during, and after participation in the program). 
For example, assume that an organization wants to compare two different 
types of tutoring programs. To accomplish this goal, they give a structured 
survey with numeric coded responses (such as a series of mathematical 
problems or a history or English knowledge test) to participants at the time 
they enter the program, and 3 and 6 months after the start of the program. 
The data collected by this survey (for example, scores on the tests of math- 
ematical, historical, or English knowledge) are statistically analyzed to deter- 
mine differences between the participants from each group. 

Qualitative data are often derived from narratives and unstructured 
interviews or participant observations. A common misconception is that 
qualitative methods lack rigor and therefore are not scientific. In fact, quali- 
tative methods can be just as scientific (meaning objective and empirical) as 
quantitative methods. They are the basis for much descriptive and classifi- 
cation work in both the social and natural sciences. They provide an oppor- 
tunity to systematically examine organizations, groups, and individuals in an 
effort to extract meaning from situations; understand meaning ascribed to 
behaviors; clarify or further explore quantitative findings; understand how a 
service program operates; and determine whether a program or services 
can be adapted for use in other contexts and with other populations. 



EVALUATING COMMUNITY PROGRAMS FOR YOUTH 

In our review of studies and evaluations that have been conducted 
on community programs serving youth, we found that a wide range of 
evaluation methods and study designs are being used, including experi- 
mental, quasi-experimental, and nonexperimental methods (see Box 
7-3). Part II provided examples of community programs for youth using 
both experimental or quasi-experimental methods, as well as a range of 
other nonexperimental methods of study, including interviews, focus 
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(Box 7-3 

Evaluation Design Methodologies 

Experimental design involves the random assignment of individuals to 
either a treatment group (in this case participation in the program being 
assessed) or a control group (a group that is not given the treatment). Many 
believe that the experimental design provides some of the strongest, most 
clear evidence in research evaluation. This design also affords the highest 
degree of causal inference, since the randomized assignment of individuals 
to an intervention condition restricts the opportunity to bias estimates of 
the treatment effectiveness. 

Quasi-experimental design has all the elements of an experiment, ex- 
cept that subjects are not randomly assigned to groups. In this case, the 
group being compared with the individuals receiving the treatment (partici- 
pating in the program) is referred to as the comparison group rather than 
the control group, and this method relies on naturally occurring variations 
in exposure to treatment. Evaluations using this design cannot be relied on 
to yield unbiased estimates of the effects of interventions because the indi- 
viduals are not assigned randomly. Although quasi-experimental study de- 
signs can provide evidence that a causal relationship exists between partici- 
pation in the intervention and the outcome, the magnitude of the effect and 
the causation are more difficult to determine. 

Nonexperimental design does not involve either random assignment 
or the use of control or comparison groups. Nonexperimental designs rely 
more heavily on qualitative data. These designs gather information through 
such methods as interviews, observations, and focus groups in an effort to 
learn more about the individuals receiving the treatment (participating in the 
program) or the effects of the treatment on these individuals. This type of 
research often consists of detailed histories of participant experiences with 
an intervention. Although they may contain a wealth of information, 
nonexperimental studies cannot provide a strong basis for estimating the 
size of an effect or for unequivocally testing causal hypotheses because they 
are unable to control for such factors as maturation, self-selection, attrition, 
or the interaction of such influences on program outcomes. They are, how- 
ever, particularly useful for generating new hypotheses, for developing clas- 
sification systems, and for gaining insight into people’s understandings. 
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groups, ethnographic studies, and case studies. It also summarized some 
findings from studies using both nonexperimental and experimental 
methods. 

There are differing opinions among service practitioners, research- 
ers, policy makers, and funders about the most appropriate and useful 
methods for the evaluation of community programs for youth (Catalano 
et al., 1999; McLaughlin, 2000; Kirby, 2001; Connell et al., 1995; 
Gambone, 1998). Not surprising, there was even some disagreement 
among committee members about the standards for evaluation of com- 
munity programs for youth. Through consideration of our review of 
various programs, the basic science of evaluation, and a set of experi- 
mental evaluations, quasi-experimental evaluations, and nonexperimental 
studies of community programs for youth, the committee agreed that no 
specific evaluation method is well suited to address every important ques- 
tion. Rather, comprehensive evaluation requires asking and answering 
many questions using a number of different evaluation models. What is 
most important is to agree to, and rely on, a set of standards that help 
determine the conditions under which different evaluation methods 
should be employed and to evaluate programs using the greatest rigor 
possible given the circumstances of the program being evaluated. At the 
end of this chapter, we present a set of important questions to be 
addressed in order to achieve comprehensive evaluation, whether it be by 
way of experiments or other methods. 

QUESTIONS ASKED IN COMPREHENSIVE EVALUATION 

To fully realize the overall effectiveness and impact of a program on 
its participants, a comprehensive evaluation should be conducted. A 
comprehensive evaluation addresses six fundamental questions: 

1. Is the theory of the program that is being evaluated explicit and 
plausible? 

2. How well has the program theory been implemented in the sites 
studied? 

3. In general, is the program effective and, in particular, is it effec- 
tive with specific subpopulations of young people? 

4. Whether it is or is not effective, why is this the case? 

5. What is the value of the program? 

6. What recommendations about action should be made? 
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These questions have a logical ordering. For instance, answers to 
the middle questions depend on high-quality answers to the first two. To 
give an example, if one is not sure that a program has been well imple- 
mented, what good does it do to ask whether it is effective? The appro- 
priate questions to answer in any specific evaluation depend in large part 
on the state of previous research on a program and hence often on the 
program’s maturity. The more advanced these matters are, the more 
likely it is that one can go on to answer the later questions in the se- 
quence above. While answering all six questions may be the ultimate 
goal, it is important to note that it is difficult to answer all questions well 
in any one study. Consequently, evaluations should not routinely be 
expected to do so. However, with multiple evaluation studies, one would 
hope and even expect that all of these questions will be addressed. An- 
swers to all of these questions may also be obtained by synthesizing the 
findings from many evaluations conducted with the same organization, 
program, or element. They may also be answered by using various evalu- 
ation methods. We now take a brief look at these questions, realizing 
that they are interdependent. 



Is the Theory of the Program Plausible and Explicit? 

Good causal analysis is facilitated by a clear, substantive theory that 
explicitly states the processes by which change will occur. Ideally, this 
theory should be the driving force in program development and should 
guide the decision of what to measure and how. The theory should 
explicitly state the components that are thought to be necessary for the 
expected effects to occur (i.e., the specific aspects of the programs — such 
as good adult role models — that account for the programs’ effects on 
such outcomes as increasing self-confidence). It should also detail the 
various characteristics of the program, the youth, and the community 
that are likely to influence just how effective the programs is with spe- 
cific individuals (i.e., the moderators of the program’s effectiveness, such 
as ethnicity or disability status). These components must then be mea- 
sured to evaluate whether they are in place in the form and quantity 
expected. 

At a more abstract level, the theory must also be plausible, taking 
into account current knowledge in the relevant basic sciences, the nature 
of the target population, and the setting in which the program interven- 
tion takes place. We provided an initial review of the existing literatures 
in Chapters 2, 3, and 4. Obviously, a program needs no further evalua- 
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tion if this stage of the analysis shows that its most fundamental assump- 
tions are at variance with well-supported current substantive theory or 
with the level of human and financial resources that can be made avail- 
able to support it. Once specified, these causal models can be used for 
two purposes: (1) to design the assessment of the quality of program 
implementation and (2) when all the data are in, to judge how plausible 
it is to infer that the observed results are due to processes built into the 
program theory. Several of the evaluations we looked at provided good 
models of such an analysis. One is the evaluation of the Girls Inc.’s 
Preventing Adolescent Pregnancy Project (e.g., Postrado et al., 1997). 

Finding a well-specified model underlying either program design or 
program evaluation is unusual. Few of the evaluations reviewed and 
discussed in this report had one (see Chapter 6 for examples). Develop- 
ment of such theoretically grounded program-specific models probably 
requires a prolonged and genuine collaboration between basic research- 
ers, applied researchers, program developers, practitioners, and program 
evaluators. We highly recommend that more funds be directed to sup- 
port such ongoing collaborations. Information in Chapters 2, 3, 4, and 
5 provides a rudimentary basis for developing such theoretically 
grounded program models. Complex generic models are needed that 
involve theorizing at the community, program, cultural, and individual 
levels because these will help determine the classes of variables to be 
included in both program and outcome evaluations, and both ongoing 
reflective practice and program study. Gambone, Connell, and their 
colleagues developed one such model (Gambone, 1998; Connell et al., 
2000). Another formed the basis for Public/Private Ventures’ new project 
around community change for youth development (Sipe et al., 1998). 
Yet others were the basis of the Midwestern Prevention Project and the 
Communities that Care initiative (described in more detail in Chapter 5). 
But even these are quite general models. Models that are quite specific to 
the program under analysis are needed. Cook and his colleagues devel- 
oped one such a model for their evaluation of the Comer School Inter- 
vention (Cook et al., 1999; Anson et al., 1991; Cook et al., 2000). This 
work is discussed in more detail later in the chapter. 



How Well Was the Program Implemented? 

Part of a program’s operational theory deals with the treatment com- 
ponents and dosage necessary to achieve the expected outcomes. An 
empirical description and analysis of the implementation of the compo- 
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nents of a program are therefore necessary to determine: (1) whether 
participants received the intended treatment and (2) how variation in the 
treatment actually received might be related to outcomes. However, too 
many outcome evaluations still contain sparse or nonexistent informa- 
tion about particular program elements. Without such a description, it is 
impossible to know, for instance, if lack of effectiveness might be due to 
poor program theory, poor implementation of what might otherwise be 
an effective treatment, or even poor evaluation that failed to detect true 
effects. If evaluators find that participants did not receive the planned 
treatment and the expected effects did not occur, then valuable informa- 
tion has been gained. It is obvious that the program is not likely to be 
effective in its current form, that a high priority of redesign is needed to 
improve implementation quality, and that the theory behind the pro- 
gram has not been tested in the evaluation since quality implementation 
is a precondition for a strong test of the theory. Without measures of 
implementation, the program can be evaluated in terms of its effective- 
ness, but the theory behind the program cannot be evaluated. 

Obviously, it is impossible to achieve perfect implementation in the 
real world of social programming, but there is much to learn from em- 
pirical details about implementation, even when the expected effects do 
not occur. We found few examples of even systematic attempts at imple- 
mentation assessment (one such example is the follow-up evaluations of 
Big Brothers, Sisters). Cook and colleagues’ evaluations of the Comer 
School Intervention provide a good example of careful implementation 
assessment (Cook et al., 1999; Anson et al., 1991; Cook et ah, 2000). 
We found a few good examples of attempts to measure exposure; these 
included ongoing evaluations of the Teen Outreach Program by Allan 
and colleagues (Allan and Philliber, 1998) and the ongoing evaluations 
of the Girls, Inc.’s Adolescent Pregnancy Prevention Project (Nicholson 
and Postrado, 1992; Postrado et ah, 1997). 

Programs in the early stages of development should focus their evalu- 
ation activities on implementation rather than outcome analysis. This is 
the period when the program itself is likely to change most rapidly as the 
original conception requires some accommodation to newly learned re- 
alities of place, time, and people. This process of growth should be 
carefully studied in its own right for the information it provides to a 
basic understanding of social systems and human development. Evalua- 
tion focused only on effectiveness is most appropriate when the program 
has matured, the theory of change has crystallized, and implementation 
has been studied enough to know that the program on the ground is not 
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some distorted caricature of the program intended. In this case, one can 
reach reasonable conclusions about effectiveness since one has confidence 
that the program itself was well implemented and the outcome measures 
are indeed theoretically related to the “treatment.” Both significant and 
null effects can inform conclusions about program effectiveness. 

In determining how well a program was implemented, it is impor- 
tant not to forget that the comparison group is never a “no-treatment” 
group. It is essential to describe what happens in the comparison groups 
in terms of their opportunities, constraints, and exposure to positive de- 
velopmental activities. Individuals not included in the experimental treat- 
ment may nonetheless gain access to, or be exposed to, similar (even if 
not identical) activities through other local organizations or through the 
influence of their friends who are in the treatment group. It is essential 
to describe these experiences, for few programs exist in a void, and many 
young people have potential access to more than one program with over- 
lapping services. All experimental evaluations assess the consequences 
of exposure not of the experimental treatment in a void, but in terms of 
the contrast between the treatment and the comparison groups. When 
the comparison group experiences similar events to the treatment group, 
we can hardly expect to find treatment effects. Such would have to be 
due to the name of the organization rather than to the specific activities 
undertaken there. In this case, the finding of nonsignificant effects (null 
effects) should not be interpreted as an indication that the program is 
ineffective. Because such careful assessment of exposure to treatment 
and treatment-like conditions is rare and because some individuals in the 
treatment condition may not actually receive it, first-order estimates of 
treatment effects are conservative in that one is rarely sure of the true 
magnitude of differential exposure of the treatment and control group to 
the program. Nonetheless, these estimates do provide information to 
policy makers regarding the value-added of putting the treatment pro- 
gram into a community . 2 

The process evaluation to provide a description of implementation 
quality can be carried out using a wide variety of both qualitative and 
quantitative data collection techniques. Among the qualitative methods 
are ethnographic data collection using a time-sampling basis or open- 
ended interviews with young people and service practitioners and man- 



individuals interested in this issue should consult references on the “ intent- to-treat” 
debates (Shadish et al., 2001; Angrist and Imbrens, 1995). 
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agers. Ethnographic studies allow researchers to examine unexpected 
events in depth, to understand important mediating processes not part of 
the original theory, and to describe how the program evolves over time. 
Such methods require a substantial time and financial investment, but in 
our judgment, they are necessary for collecting rich descriptive data that 
allow the researchers to understand the program better and to communi- 
cate these understandings more graphically. Of course, the same kinds 
of data need to be collected with comparison group members whenever 
possible, adding to the time and dollar commitment involved. 

Among the quantitative methods for describing implementation are 
closed-ended interviews or questionnaires administered to youth in the 
each group and to service practitioners. Good quantitative analysis re- 
quires a clear program theory and measures that can be used over time to 
determine the extent to which the program is moving toward sound 
implementation. When done well, these quantitative analyses can pro- 
vide a good assessment of how well an intervention has been implemented 
in the way it was formulated at the time the data collection began. Some 
questionnaire items can also ask about changes in order to document the 
dynamic, changing nature of some programs. 

It is important to remember that in experimental program evalua- 
tions, it is highly desirable — if not necessary in theory — that the assess- 
ment of implementation quality be identical for the treatment and con- 
trol groups (the same is actually also true in other forms of evaluation). 
A difficulty here is that the control group members may be in a single 
alternative program or in none at all. Moreover, if implementation scores 
are to be attached to individual young people to describe the variation in 
treatment they actually receive, then the desirability of assessing imple- 
mentation for all young people rather than a sample of them or for the 
setting in the aggregate increases. The greater the anticipated variability 
in individual exposure patterns, the greater the need for respondent-spe- 
cific measures of implementation. These can be expensive and disrup- 
tive, although means do exist to deal with each of these concerns. 

An important aspect of implementation is dropping out of a pro- 
gram. Dosage usually involves some form of length of program expo- 
sure. Indeed, program practitioners are reluctant for their program to be 
evaluated by criteria that include in the evaluation those who have had 
limited exposure to program activities. This is understandable; conse- 
quently, at a minimum, exposure lengths need documenting, since re- 
taining young people in the program is something all programs strive for 
and success in this area speaks to the developmental appropriateness of 
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the content and the skills of the staff. If it turns out that there are group 
differences in the length of exposure to program activities in a random- 
ized experiment comparing two different programs, for example, then 
this information can be used to get an unbiased program effect. It is 
important that the information on differences in exposure is considered 
in relation to the variation in changes in important developmental out- 
comes. Since practitioners certainly want to see analyses that evaluate 
their program at its strongest (even if not in its most typical state), some 
subanalyses assessing impacts for the subset of young people that attends 
a program for a long period of time and is exposed to activities that meet 
the state of the art in youth programming are important. 



Various evaluation methods can be used to answer this question, 
including randomized experiments, quasi-experiments, interrupted treat- 
ment designs, theory-based evaluation, and qualitative case studies 

Randomized Experiments 

This effectiveness question can be rephrased in the following way: 
Would any observed changes in the youth exposed to the activities under 
evaluation have occurred without the program? In other words, would 
the changes have occurred because of temporal maturation alone, be- 
cause of selection differences between the kinds of young people exposed 
to two different sets of experiences that are being contrasted, due to 
statistical regression, or due to being tested on two different occasions 
and learning from the first one what to say or write on the second one? 
Although attributing change to the treatment by ruling out the effects of 
alternative change-inducing forces is central to science, funders, and most 
taxpayers, it seems to be a lower priority for many program practitio- 
ners. Documenting desired change during the course of program expo- 
sure is not the same as attributing the change to the program rather than 
to one of the many other forces that get people to change spontaneously. 

The best way to answer the effectiveness question is through an 
evaluation that is experimental in design. However, despite the fact that 
experimental designs with random assignment allow the highest level of 
confidence in evaluating planned program effects (Shadish et ah, 2001), 
true experimental designs with random assignment are not always the 
most appropriate design; these designs are most useful when a causal 
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question is being asked and not all evaluations are designed to address a 
causal question. (Common noncausal questions include: How well was 
the program implemented? What is the cost-benefit ratio for the pro- 
gram?) Randomized experiments are also not always practical, although 
they have turned out to be feasible in far more contexts than was thought 
to be the case even a decade ago (Gueron, 2001). 

Nonetheless, they are often difficult to implement and program staff 
are often reluctant to participate in experimental evaluations for a vari- 
ety of reasons — ranging from the difficulty and inconvenience often im- 
posed by this method to very serious concerns about the ethics of deny- 
ing an opportunity or service to a large portion of the adolescents needing 
it. Even so, experiments are the method of choice for evaluating the 
effectiveness of programs in communities, and program staff need to be 
part of the ongoing debates about the feasibility of random assignment, 
raising their objections and carefully considering the responses made to 
these objections. What is not desirable is that some veto be pronounced 
without serious consideration having been given to a strong design. In 
this connection, it is important for those who fund evaluation to be ex- 
plicit in favoring random assignment experimental evaluations when the 
question of cause and effect is being asked. Such favoring exists in most 
disciplines today, but there is mixed support for this method in the emerg- 
ing area of community programs for youth. And although the ethics of 
denying service to needy adolescents is a very serious concern, there are 
often more applicants for the program than can be served. In this case, 
random selection either into the program or onto a wait list can be imple- 
mented in a manner that is fair to all potential participants. 



Quasi-Experiments 

Strong quasi-experimental designs are sometimes a more realistic 
approach to assessing effectiveness. Shadish, Cook, and Campbell (2001) 
discuss a wide number of quasi-experimental designs that vary in their 
strength for inferring a causal relationship between programs and change 
in young people. At a minimum, a strong quasi-experimental design 
entails two things: (1) extensive knowledge of young people’s behavior 
and attitudes prior to or at the onset of treatment exposure, including 
pretest information on the very same measures that will be used for the 
posttest outcome assessment, and (2) comparison groups that are delib- 
erately and carefully selected to be minimally different from the program 
groups. The latter is attained through careful matching procedures on 
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reliable variables that are as highly correlated with the major outcomes 
as possible. Even stronger designs are outlined in Shadish, Cook, and 
Campbell (2001). 

Done properly, both experimental and quasi-experimental methods 
provide quite valid information about program effectiveness. Internal 
validity is best addressed by the random assignment of subjects to con- 
trol and experimental groups. But without it, pretest measures can be 
used to make sure the groups are similar on the highest and most distinct 
correlates of the major outcomes. Then statistical tests can be used to 
determine whether the two groups remain similar over time (that is, that 
those who drop out of the study from the two groups are similar to each 
other — leaving the remaining members of the two groups similar to each 
other on the pretest measures). Analyzing the experimental-control 
group contrast in order to assess whether there are differences between 
the groups on valid and theoretically appropriate outcome measures pro- 
vides sound evidence of the effectiveness of the program. 

However, as discussed earlier, doing rigorous experimental and 
quasi-experimental evaluation studies is very difficult for community 
programs for youth because such programs, by their very nature, make 
randomized trial designs very difficult to implement. Consequently, 
stakeholders should be sure they need this level of evaluation before ask- 
ing for it. Also, as discussed previously, the best programs for youth are 
dynamic and evolving in nature. In other words, they are continually 
experimenting with ways to improve and are better characterized as 
learning systems than as a tightly specified program. Such programs are 
difficult to evaluate with a randomized trial design. Box (1958) has 
provided an alternative model of evaluation that is better suited to this 
type of situation — the “evolutionary evaluation method.” Essentially, 
Box outlines a method for doing mini-randomized trials within an orga- 
nization to test the effectiveness of new activities and program modifica- 
tions. As far as we know, this method has not been used in community 
programs for youth, but it would a useful tool for organizations to use as 
they make changes in their array of programs. 



Interrupted Time-Series Designs 

Interrupted time-series is another methodology that can be used for 
evaluating programs aimed at youth in a community (Biglan et al., 2000). 
The method requires a series of observations prior to entering a program 
and then at least one observation afterward, although more are desir- 
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able. These observations can be of individual young people or on some 
collective, such as those attending the program at previous time points. 
But in the latter case, the object of evaluation has to be some change 
within a program rather than the program itself. Statisticians argue for 
about 100 time points, but that is usually not possible. This is why Cook 
and Campbell (1979) and Shadish et al. (2001) argue in favor of abbre- 
viated time-series in which the deviation from a past trend can be ob- 
served even if the nature of the correlated error in the series has to be 
assumed rather than directly measured. At issue is noting whether there 
is a shift in the abbreviated series’ mean or trend following entry into a 
program, or whether it is a program introducing some new practice that 
is being evaluated. The value of this approach is that it can rule out 
alternative interpretations to the program effect that are based on matu- 
rational changes in the young people or on statistical regression common 
in situations in which a program is begun or modified because the situa- 
tion in a community has suddenly worsened. The major problem, 
though, is that events that occur simultaneously with the new program 
or practice may also be responsible for any changes observed. To counter 
this alternative explanation, it is often useful to introduce a control time- 
series from a location nearby, where the new practice under evaluation 
was not implemented. Shadish et al. (2001) provide a long list of vari- 
ants on the abbreviated time-series analysis that can be used in specific 
kinds of circumstances. 

Yet another evaluation possibility is offered by regression-disconti- 
nuity designs (Shadish et al., 2001). These have been repeatedly rein- 
vented over the past 35 years in one social science discipline after 
another. Their key element is assignment to a program based on a quan- 
titative score and nothing else. Thus, if young people can be assessed in 
terms of need or merit or their turn in the queue to enter a program, and 
if program participation depends on this score and nothing else, then an 
unbiased inference can be made about the program’s effects. If there is a 
main effect of the treatment, then there will be a discontinuity in the 
intercept of the regression line at the score that determines treatment 
eligibility; and if there is an interaction with the assignment score (or 
some correlate thereof), then the regression slopes will differ on each side 
of the cutoff. It seems counterintuitive at first that this design should 
result in unbiased inference. After all, assignment to treatment depends 
on the very selection processes that the randomized experiment was de- 
signed to rule out. Yet both designs have a key characteristic in com- 
mon — that the assignment to treatments is completely known. This is 
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the key design characteristic necessary for producing an unbiased statis- 
tical inference. With the randomized experiment, assignment is known 
to depend only on some equivalent to the coin toss, while in the regres- 
sion-discontinuity design, it depends only on the score on the quantita- 
tive assignment variable. 

Neither of these evaluation possibilities has been used much for ex- 
amining youth programs — and neither will be easy to implement. Yet 
there are circumstances in which there is a long previous time-series of 
information at either the individual or the community level. We recom- 
mend in the next chapter that communities gather information about the 
well-being of their youth on a much more regular basis. If such informa- 
tion were systematically available in more communities, using the inter- 
rupted time-series design to assess program effectiveness at the commu- 
nity level would become much easier. There are also likely to be other 
circumstances in which it is ethical and politically acceptable to assign to 
services only those most in need, those most meritorious, or those who 
most press for program entry. Often this occurs when there is more 
demand for the program than spaces available. Of course, having more 
demand for the program than supply also means that a randomized ex- 
periment is feasible, and a randomized experimental evaluation is supe- 
rior to the regression-discontinuity design, even if only because its statis- 
tical power is greater. If evaluationary practice is to be improved in the 
youth development area, there will have to be greater concern for ran- 
dom assignment, regression-discontinuity, interrupted time-series, and 
quasi-experiments that have strong rather than weak designs. At a mini- 
mum, this means designs with pretest measures on the same variables as 
the outcomes, matched control groups, replications of the treatment, and 
statistical analyses that take account of modern developments in statis- 
tics, especially propensity score analyses (Rosenbaum, 1992) and recent 
versions of instrumental variables that emphasize local control groups, 
pretests, direct observation of the determinants of program participation 
and sensitivity analyses (Heckman et ah, 1996). 



Theory-Based Evaluation 

Some evaluators have suggested an alternative method for inferring 
effectiveness — theory-based evaluation. These evaluation theorists be- 
lieve that theory-based evaluation can answer the question of whether 
the program is effective. 
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Theory-based evaluation acknowledges the importance of substan- 
tive theory, quantitative assessment, and causal modeling, but it does not 
require experimental or even quasi-experimental design. Instead it fo- 
cuses on causal modeling derived from a well-specified theory of the 
processes that take place between program inputs and individual change. 
If the causal modeling analyses suggest that the obtained data are consis- 
tent with what the program theory predicts, then it is presumed that the 
theory is valid and success of the program has been demonstrated. If 
time does not permit assessing all the postulated causal links, informa- 
tion on the quality of initial program implementation nonetheless will be 
gathered because implementation variables are usually the first constructs 
in the causal model of the program. If the first steps in the theory are 
proceeding as predicted, the evaluators can then recommend that further 
evaluations be conducted when sufficient time has passed for the pro- 
posed mediating mechanisms to have their full effect on the proposed 
outcomes. This should prevent any inclinations toward premature ter- 
mination of programs, even though it does not demonstrate that the ul- 
timate outcomes have been reached. 

It is without question that the analysis of substantive theory is neces- 
sary for high-quality evaluation. Otherwise, analyses of implementation 
and causal processes cannot be carried out. However, the key question 
is whether a theory-based model can substitute for experiments rather 
than be built into them. It is not logical that long-term effects will come 
about just because the proposed mediators have been put into place. 
Without control groups and sophisticated controls for selection, it is 
impossible to conclude with any reasonable degree of confidence that the 
program is responsible for the changes observed rather than some co- 
occurring set of events or circumstances. Theory-based experimental 
approaches provide more confidence that it is the program itself that is 
accounting for the effects, and they also provide strong clues as to 
whether the program will continue to be effective in other sites and set- 
tings that can recreate the demonstrably effective causal processes. We 
support the use of program theory in evaluation, but as adjuncts to ex- 
periments rather than as substitutes. 



Qualitative Case Studies 

Some argue that qualitative case studies are sufficient for producing 
usable causal conclusions about a program’s effects. These are studies 
that focus on gaining in-depth knowledge of a program through inter- 
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views with various individuals involved, on-site observation, analysis of 
program records, and knowledge of the literature on programs like the 
one under review. Such studies involve little or no quantitative data 
collection and hence little manipulation of the data. Moreover, although 
some case studies include multiple program sites both for purposes of 
generalization and for comparison of different kinds of programs, case 
studies often concentrate on only a few sites, sometimes only one, be- 
cause resources are usually too limited to collect in-depth information on 
many sites. The result is therefore to gain in-depth knowledge of only a 
few sites. 

Case studies, done singly or at a sample of sites, are useful for de- 
scribing and analyzing a program’s theory, for studying program imple- 
mentation, for surfacing possible unintended side effects, and for helping 
explain why the program had the effects it did. They are also very useful 
at the stage of theory development. Some programs are thought to work: 
sometimes this conclusion is based on randomized treatment designs of 
omnibus programs; at other times, it is based on more subjective criteria, 
such as user satisfaction or continued evidence of high performance by 
its users on criteria valued in the community.- High-quality case studies 
can help one understand more about these programs. In turn, this infor- 
mation can be used to design and then evaluate the effectiveness of these 
newly designed programs using the more quantitative experimental de- 
signs discussed earlier in this chapter. 

Qualitative case studies can also help reduce some of the uncertainty 
about whether a program has had specific effects, since they often rule 
out some of the possible spurious reasons for any changes noted in an 
outcome. Finally, qualitative case studies often provide exactly the kinds 
of information that are useful to policy makers, journalists, and the pub- 
lic. These studies provide the kind of rich detail about what it means to 
youth and their families to participate in particular programs. Of course, 
such information can be misused, particularly if it is not gathered with 
rigorous methods; such misuse of information is also possible using quan- 
titative experimental methods. But when done with scientific rigor, par- 
ticularly if done in conjunction with rigorous experimental and quantita- 
tive quasi-experimental studies, qualitative information can provide very 
important insights into the effectiveness of youth programs. 

A separate issue is whether such studies reduce enough uncertainty 
about cause to be useful. The answer is complex and depends in part on 
how this information is to be used. In the committee’s view, such infor- 
mation can often be useful to program practitioners who want informa- 
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tion that will help them improve what is going on at their site. Case 
studies are probably a better source of information than having no infor- 
mation about change and its causes, and program personnel want any 
edge they can get to improve what they do. Leavened by knowledge 
from the existing relevant literature, the data collected on site, and the 
staffs other sources of program knowledge, the results of a case study 
can help local staff improve what they do. 

However, when the purpose of the evaluation is to estimate the ef- 
fectiveness of a program in helping participants, we have doubts about 
the utility of case studies. There are three reasons for this. First, it is 
often difficult to assess how much each participant has changed from 
their entry into the program to later. Second, and perhaps most impor- 
tantly, there is no counterfactual against which to assess how much the 
participants would have changed had they not been in the program. And 
third, conclusions about effectiveness always involve a high degree of 
generalization — e.g., across persons, service practitioners, program in- 
puts — and many qualitative researchers are reluctant to make such gen- 
eralizations. They prefer to detail many known factors that make some 
difference to an outcome, and this is not the same as noting what average 
effect the program has or how its effectiveness varies by just a few care- 
fully chosen factors. 



Identifying the Most Appropriate Method 

Experimental evaluation methods are often considered the gold stan- 
dard of program evaluation and are recommended by many social scien- 
tists as the best method for assessing whether a program influences de- 
velopmental outcomes in young people. However, many question the 
feasibility, cost, and time intensiveness of such methods for evaluating 
community programs for youth. In order to generate new, important 
information about community programs for youth, the committee rec- 
ommends that the kind of comprehensive experimental evaluation dis- 
cussed in this chapter be used under certain circumstances (see also foot- 
note 1): 

1. The object of study is a program component that repeatedly occurs 
across many of the organizations currently providing community 
services to youth; 

2. An established national organization provides the program being 
evaluated through a system of local affiliates; and 
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3. Theoretically sound ideas for a new demonstration program or 
project emerge, and pilot work indicates that these ideas can be 
implemented in other contexts. 

Comprehensive experimental evaluation is useful when the focus of 
evaluation is on elements that can be found in many organization pro- 
viding services to youth: how recruitment should be done and continued 
participation should be supported; how youth and parent involvement 
should be supported; how youth’s maturity and growing expertise should 
be recognized and incorporated into programming; how staff members 
should be recruited and then trained; how coordination with schools 
should be structured; how recreational and instructional activities should 
be balanced; how mentoring should be carried out; how service learning 
should be structured and supported; and how doing homework should 
be supported. Typically, these are components in any single organiza- 
tion, but they are extremely important because they are common issues 
in organizations across the country. In our view, such elements are best 
examined by way of experimental research in which a sample of organi- 
zations is assigned to different ways of solving the problem identified. 
Although such work has the flavor of basic research on organizational 
development, it is central to an effectiveness-based practice of commu- 
nity youth programming. 

Equally critical to an effectiveness-based practice approach is knowl- 
edge of the individual- and community-level factors that influence the 
effectiveness of these practices for different groups of individuals or com- 
munities. Consequently, it is also important that experimental methods 
be used to assess the replicability of such practices in different communi- 
ties and with different populations of youth. Particular attention here 
needs to be paid to such individual and community differences as cul- 
ture, age and maturity, sex, disability status, social class, educational 
needs, and other available community resources. 

Comprehensive experimental evaluations are also called for in two 
other contexts. The first is when the target of evaluation is a national 
organization that has affiliates in many locations across the United States. 
The best model of this is the evaluation completed on Big Brothers Big 
Sisters to assess the effects of membership and of participation across the 
affiliates included in the sampling design. Many of these national orga- 
nizations have been providing services to youth for many years and carry 
a disproportionate burden of current service provision. As a result, even 
when programs are still developing at the margins, many have mature 
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program designs. Since the total effect of these organizations is ampli- 
fied across its affiliates, experimental evaluation with random assign- 
ment helps illuminate how effective these programs are. 

The final context for comprehensive experimental evaluation is when 
some bold new idea for a new kind of service surfaces and critical exami- 
nation shows that the substantive theory behind the idea is reasonable 
and that it is indeed likely to be able to be implemented. This situation 
is often called a demonstration project. Such demonstrations provide the 
substantive new ideas out of which the next generation of superior ser- 
vices is likely to emerge. As such, they deserve to be taken very seriously 
and to be evaluated by rigorous experiments. 

Programs that meet the following criteria should be studied on a 
regular, ongoing basis with a variety of either nonexperimental methods 
or more focused experimental, quasi-experimental and interrupted time- 
series designs, such as those advocated by Box (1958): 

1. An organization, program, project, or program element has not 
sufficiently matured in terms of its philosophy and implementa- 
tion; 

2. The evaluation has to be conducted by the staff of the program 
under evaluation; 

3. The major questions of interest pertain to the quality of the pro- 
gram theory, implementation of that theory, or the nature of its 
participants, staff, or surrounding context; 

4. The program is quite broad, involving multiple agencies in the 
same community; and 

5. The program or organization is interested in reflective practice 
and continuing improvement. 



An explanation of the reasons why a program is effective is impor- 
tant because it identifies the processes that are thought to be present for 
effectiveness to occur (Cook, 2000). This knowledge is crucial for repli- 
cation of program effects at new sites because of the uniqueness inherent 
in delivering the program to new populations and in new settings. Causal 
or explanatory knowledge not only identifies the critical components of 
program effectiveness, but also specifies whether these components are 
moderator variables (variables that change the relation between an inter- 
vention and an outcome; common moderator variables include all types 



If Effective, Why? 



ERIC 




222 



Community Programs to Promote Youth Development 



of individual difference constructs, such as sex, ethnic group, disability 
status, age, and social class) or mediator variables (variables that medi- 
ate the impact of an intervention on specific outcome variables; common 
mediators variables are the many personal and social assets discussed in 
Chapter 3 — these are often hypothesized to mediate the impact of pro- 
gram features on adolescent outcomes, such as school achievement, 
avoidance of getting involved in problematic behaviors, and conditions 
such as very early pregnancy). Supported by a clear understanding of the 
causal processes underlying program effectiveness, practitioners at new 
sites can decide how the processes can best be implemented with their 
unique target population and their unique community characteristics. 

Mixed methods are the most appropriate way to answer the ques- 
tion of why a program is effective. Theory-based evaluation is especially 
appropriate here and depends on the following steps (Cook, in press): 

1. Clearly stating the theory a program is following in order to bring 
about change. This theory should explicitly detail the program 
constructs of both mediator and moderator relations that are sup- 
posed to occur if the intended program intervention is to impact 
major target outcomes. Chapters 2 and 3 can serve as an initial 
basis for developing elaborated theories of change. 

2. Collecting both qualitative and quantitative data over time to 
measure all of the constructs specified in the program’s theory of 
change. 

3. Analyzing the data to assess the extent to which the predicted 
relations among the treatment and the outcome variables have 
actually occurred in the predicted time sequence. If the data col- 
lection is limited to only part of the postulated causal chain, then 
only part of the model can be tested. The goal, however, should 
be to test the complete program theory. 

A qualitative approach to theory-based evaluation collects and syn- 
thesizes data on why an effect came about; through this process, this 
approach provides the basis to derive subsequent theories of why the 
change occurred. The qualitative data are used to rule out as many 
alternative theories as possible. The theory is revised until it explains as 
much of the phenomenon as possible. 

Both quantitative and qualitative implementation data can also tell 
us a great deal about why programs fail. In addition, these studies make 
it clear how the programs are nested into larger social systems that need 



Generating New Information 



223 



to be taken into account. When adequate supports are not available in 
these larger social systems, it is unlikely that specific programs will be 
able to be implemented well and sustained over time. 



If Effective, How Valuable? 

If a youth program is found effective, a comprehensive evaluation 
can then ask: Is it more valuable than other opportunities that could be 
pursued with the resources devoted to the program? Or, less compre- 
hensively, is it more valuable than other programs that pursue the same 
objective? The techniques of benefit-cost analysis and cost-effectiveness 
analysis can offer partial but informative answers to these questions. 

The fundamental idea of benefit-cost analysis is straightforward: 
comprehensively identify and measure the benefits and costs of a pro- 
gram, including those that arise in the longer term, after youth leave the 
program, as well as those occurring while they participate. If the benefits 
exceed the costs, the program improves economic efficiency — the value 
of the output exceeds the cost of producing it — and makes society better 
off. If the costs exceed the benefits, society would be better off devoting 
the scarce resources used to run the program to other programs with the 
same goal that do pass a benefit-cost test, or to other purposes. 

Choices among competing uses of scarce public and nonprofit re- 
sources inherently embody judgments about relative benefits and costs. 
Benefit-cost analysis seeks to make the basis of such choices explicit so 
that difficult trade-offs can be better weighed. At the same time, benefit- 
cost analysis neither can nor should be the sole determinant of funding 
decisions. Aside from the limitations of any specific study, this technique 
cannot take into account moral, ethical, or political factors that are cru- 
cial in determining youth program policy and funding. 

Any benefit-cost analysis must consider several key issues. What 
counts as a benefit? A cost? How can one measure their monetary 
value? If a benefit or cost is not measurable in monetary terms, how can 
it enter the analysis? How can one extrapolate benefits or costs after a 
youth leaves a program and any follow-up period when impact data are 
gathered? The costs of youth programs mostly occur at the outset, while 
the benefits may be realized many years later. How should benefits and 
costs at different times be valued to reflect the fact that a dollar of benefit 
received in the far future is worth less a dollar received in the near future, 
and that both are worth less than a dollar of cost incurred in the present? 
How can one assess benefits and costs to youth who participate in the 
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program, to taxpayers or other program funders, and to society as a 
whole? Persons who bear the costs of a program may well differ from 
those who share in the benefits. How can one incorporate these distribu- 
tional impacts into the analysis? An enormous literature has arisen to 
address these issues. There are several excellent texts on the subject (e.g., 
Boardman et al., 1996; Zerbe and Dively, 1997). 

If the principal benefit expected from a youth program cannot be 
given monetary values, cost-effectiveness analysis can be an alternative 
to benefit-cost analysis (Boardman et al., 1996). Suppose, for example, 
that the primary goal is to increase volunteer activity in community 
groups and that other possible program impacts are of little import to 
decision makers. In such a case, programs might be compared in terms 
of the number of volunteer hours they inspire per dollar of cost. Deci- 
sion makers will want to fund the program that produces the largest 
increase in hours per dollar spent. 

Focusing on one goal is a strength in that it obviates the need to 
express the value of the outcome in monetary terms. Yet when interven- 
tions have multiple goals and no one has clear priority, cost-effectiveness 
data may not offer much guidance. If one youth program increases vol- 
untary activity by 20 percent and reduces drug use by 15 percent and an 
alternative, equally costly program has an increase of 12 percent and a 
reduction of 20 percent, which is better? When there are multiple types 
of benefits, none of which dominates, and when some can be cast in 
monetary terms, a benefit-cost analysis that considers both monetary 
and nonmonetary benefits will usually provide more useful information 
than a cost-effectiveness analysis. 

Systematic benefit-cost analysis has hardly been applied to youth 
programs, except for those likely to reduce juvenile crime (Aos et al., 
2001). While application of this methodology to youth development 
programs is complex, it is no more so than in other areas of social policy, 
in which it has made significant contributions to research and policy 
analysis (e.g., health and mental health, early childhood education, job 
training, welfare-to-work programs). To advance youth program evalu- 
ation in this direction will require more rigorous evaluations with ad- 
equate follow-up periods and suitable data on a broad set of impacts. 

Analysts and practitioners may be concerned that benefit-cost 
analysis will lead decision makers to focus too narrowly on financial 
values and downplay or ignore other important program impacts that 
cannot be translated into financial terms. However, a careful analysis 
will discuss nonmonetary benefits and emphasize that a complete assess- 
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ment of programs when important social values are at stake, such as in 
the area of youth development, must weigh such benefits along with the 
monetary ones. Analyses that fail to do so can be criticized for present- 
ing an incomplete picture. 

As with other evaluation methods, any benefit-cost analysis has 
limitations. It can be questioned because its results rest on judgments 
about which impacts to quantify and various other assumptions needed 
to conduct an analysis. Time and resource constraints prevent investiga- 
tion of all possible benefits and costs. Some effects may be inherently 
unquantifiable or impossible to assess in financial terms yet considered 
crucial to a program’s success or political viability. Nonetheless, when 
carefully done with attention to the findings’ sensitivity to different as- 
sumptions, benefit-cost analysis can improve the basis on which youth 
development policy decisions rest. 

SUMMARY 

In this chapter, we reviewed fundamentals of evaluation and impor- 
tant questions for the development of a comprehensive evaluation strat- 
egy. Several conclusions emerge from this discussion. 

First, there are many different questions that can be asked about a 
program. A priority for program practitioners, policy makers, program 
evaluators, and other studying programs is to determine the most impor- 
tant questions and the most useful methods to evaluate each program. It 
is very difficult to understand every aspect of a program in a single evalu- 
ation study. Like other forms of research, evaluation is cumulative. 

The committee identified six fundamental questions that should be 
considered in comprehensive evaluation: 

° Is the theory of the program that is being evaluated explicit and 
plausible? 

0 How well has the program theory been implemented in the sites 
studied? 

0 In general, is the program effective and, in particular, is it effec- 
tive with specific subpopulations of young people? 

° Whether it is or is not effective, why is this the case? 

0 What is the value of the program? 

0 What recommendations about action should be made? 

While it is difficult to answer all six questions well in one study, 
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multiple studies and evaluations could be expected to address all of these 
questions. Comprehensive evaluation requires asking and answering 
many of these questions through various methods. Opinions differ opin- 
ions among program stakeholders (e.g., service practitioners, research- 
ers, policy makers, and funders) about the most appropriate and useful 
methods for the evaluation of community programs for youth. No spe- 
cific evaluation method is well suited to address every important ques- 
tion. And while there is tension between different approaches, the com- 
mittee agrees that there are circumstances that are appropriate for the 
use of each of these methods. The method used depends primarily on the 
program’s maturity and the question being asked. It is rare to find pro- 
grams that involve comprehensive evaluations, and they are probably 
most warranted with really mature programs that many people are inter- 
ested in. 

The committee concluded that studying program effectiveness should 
be a regular part of all programs. Also, not all programs require the 
most extensive comprehensive experimental evaluation outlined in this 
chapter. In order to generate the kind of information about community 
programs for youth needed to justify large-scale expenditures on pro- 
grams and to further fundamental understanding of role of community 
programs in youth development, comprehensive experimental program 
evaluations should be used when: 

© the object of study is a program component that repeatedly occurs 
across many of the organizations currently providing community 
services to youth; 

® an established national organization provides the program being 
evaluated through many local affiliates; and 

© theoretically sound ideas for a new demonstration program or 
project emerge, and pilot work indicates that these ideas can be 
implemented in other contexts. 

Such evaluations need to pay special attention to the individual- and 
community-level factors that influence the effectiveness of various prac- 
tices and programs with particular individuals and particular communi- 
ties. 

The committee also discussed the need for more ongoing collabora- 
tive teams of practitioners, policy makers, and researchers/theoreticians 
in program design and evaluation. We conclude from case study materi- 
als on high-quality comprehensive evaluation efforts that the odds of 
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putting together a successful high-quality comprehensive evaluation are 
increased if there is an ongoing collaboration between researchers, policy 
makers, and practitioners. Yet such collaborations are hard to create 
and maintain. 

When experiments are not called for, a variety of nonexperimental 
methods and more focused experimental and quasi-experimental studies 
are ways to understand and assess these types of community programs 
for youth and help program planners and program staff build internal 
knowledge and skills and can highlight theoretical issues about the devel- 
opmental qualities of programs. Such systematic program study should 
be a regular part of program operation. 

Comprehensive evaluation is dependent on the availability, accessi- 
bility, and quality of both data about the population of young people 
who participate in these programs and instruments to track aspects of 
youth development at the community and program levels. The next chap- 
ter explores social indicators and data instruments to support these needs. 
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o Participates in volunteer activities 
o Has a positive outlook 
o Reads for pleasure 

o Misses school regularly 
o Has been arrested 
o Participates in a gang 

O ver the past decade, communities, cities, states, and na- 
tions have become increasingly interested in knowing what 
percentage of their youth population is doing well and 
what percentage is doing poorly (Brown and Corbett, 
forthcoming; Kingsley, 1998). To estimate these numbers, 
scientists and policy makers have generated both a grow- 
ing list of social indicators of well-being and problem 
behaviors and set about gathering the data. As a result, 
there are now data and related technical assistance re- 
sources to support youth development work. This work, 
however, has also produced a keen awareness among prac- 
titioners of the limitations of these resources and the need 
to increase their quality, breadth, and availability in the 
coming decade (MacDonald and Valdivieso, 2000). 
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In this chapter we review these resources in light of the youth devel- 
opment framework developed in Part I and the variety of practical appli- 
cations for which the data and resources are needed. Our review of data 
and resources includes: (1) relevant administrative and vital statistics data 
that are commonly available at the community level, (2) community sur- 
veys and topic-specific instruments that can be used to track aspects of 
youth development not well covered by administrative data, and (3) se- 
lected national surveys focusing on youth. We then discuss data collec- 
tion to support implementation and reflective practice in individual com- 
munity programs for youth. Finally, we review the efforts of key national 
intermediary organizations that have developed resources and technical 
assistance materials for use by local youth development efforts interested 
in social indicator data. The chapter concludes with suggestions regard- 
ing: (a) the need for enhanced access of community youth programs to 
social indicator data and to the training needed to use them effectively, 
(b) the development and fielding of new measures, and (c) an expanded 
role for national intermediaries to support these goals. 

USES OF SOCIAL INDICATOR DATA 

The uses of social indicator data for community programs for youth 
and youth initiatives include needs assessment, service targeting, goals 
tracking, program accountability, and reflective practice to improve pro- 
gram and policy effectiveness over time. Any assessment of available 
data resources to support this work needs to be understood in the con- 
text of their use. 



Needs and Resource Assessment 

Assessing the needs of youth in a community is a common starting 
point for many community youth initiatives. Whole communities may 
do a general assessment using available data to identify the areas of great- 
est need for their youth, which can then be addressed in a coordinated 
fashion by multiple programs and agencies. Organizations (e.g., the 
United Way, the YWCA, a local synagogue) can also use such data to 
shape their own programs, targeting their efforts in areas of greatest 
need (United Way of America, 1999). Strengths in the community (cul- 
tural, financial, etc.) that could be mobilized to meet the needs are often 
identified as part of the same process. 

Most communities are limited to available administrative data 
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sources, such as service program data, health surveillance, vital statistics, 
school performance data, decennial census, police reports, and so on. 
Because of the limited nature of these data, some communities are field- 
ing their own surveys for a more complete assessment. In many cases, 
however, community programs for youth are started in response to needs 
that are obvious to those who work with the youth without consulting 
any data resources. Nonetheless, however, a more formal documenting 
of need can help even in these cases to elicit the cooperation and interest 
of other actors both inside and outside the community, including funders. 

Tracking Progress Toward Goals 

Virtually all youth initiatives have some goals that can be translated 
into social indicator language. Community-wide youth initiatives often 
set goals to improve selected dimensions of youth well-being in specific 
and measurable ways. These goals then serve to focus the activities of 
multiple organizations in the community. In Tillamook County, Or- 
egon, for example, the community agreed to focus on lowering the teen 
birth rate, which was then one of the highest in the state. Many local 
organizations, some with very different ideas and strategies for address- 
ing the issue, worked to reduce teen births in the county. Over a period 
of four years, the rate was cut by 70 percent, giving the county the lowest 
teen birth rate in the state (National Campaign to Prevent Teen Preg- 
nancy, 1997). 

The federal Healthy People 2010 initiative is another useful example. 
Participating states and communities adopt specific goals across a host of 
health outcomes to be achieved by the year 2010. 1 Public and private 
health organizations focus their efforts on one or more of these goals so 
that, together, they can make measurable progress at the community or 
state level. Social indicator data are the primary source used to assess 
this progress. Individual programs can also use social indicator data as 
tools for setting and tracking progress toward their specific goals. 



Accountability 

Social indicator data are increasingly used by funders to hold pro- 
grams and initiatives accountable for measurable results in many areas, 
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including youth well-being and development. Successful improvement in 
the targeted areas of development may be met with increased funding. 
Failure to meet specified goals may result in the provision of technical 
assistance to overcome problems or in the loss of funding or autonomy. 
Such accountability practices are becoming increasingly common in state 
and local educational assessment efforts, for example (Brown and 
Corbett, forthcoming). Community-level indicators are rarely used for 
this purpose, as individual programs are not generally expected to have a 
community-wide impact on youth well-being. Instead, they are held ac- 
countable for outcomes to program participants. 



Reflective Practice 

Community programs for youth can also use social indicator data to 
monitor their own success and to guide program refinement (i.e., they 
can use social indicator data as part of reflective practice). At its most 
formal level, programs can develop a detailed model relating program 
activities to interim and long-term project goals for participating youth 
(United Way of America, 1999; Gambone, 1998; Weiss, 1995). In the 
best case, such a model of the links between program activities and youth 
outcomes will be based on existing research (when it exists), theory, and 
the shared beliefs of those running the program. Both program activities 
and youth outcomes can then be measured and tracked over time. Fail- 
ure to produce the expected results could indicate inadequate implemen- 
tation of some part of the program, or it may call into question one or 
more of the underlying assumptions of the model. Practices, the model, 
or both can then be reevaluated as a result and the programs can be 
modified. 

In many respects reflective practice functions like program evalua- 
tion, even though it lacks the methodological rigor required to draw firm 
causal inferences about the relations between program activities and 
youth outcomes (see Chapter 7 for discussion of evaluation methodolo- 
gies). However, the level of certainty required to qualify results as scien- 
tific knowledge is not needed to produce good guides for responsible 
program management. And programs can sometimes incorporate some 
of the practices associated with experimental evaluations into their re- 
flective practices. For example, they can compare the social indicator 
data from their catchment area with social indicator data being collected 
longitudinally in other comparable catchment areas (stimulating a quasi- 
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experimental design, provided that the data are being collected over time 
beginning before the program change is put into place). 

DATA SOURCES 

Communities and youth programs interested in tracking indicators 
of youth development have two major sources of data to draw from: 
administrative and related data sources (e.g., school records, crime re- 
ports, social service receipt, vital statistics, decennial census) and sur- 
veys. Every community already has data relevant to youth development 
from its administrative data collection efforts, although there can be sub- 
stantial differences across communities in the accessibility of those data 
to the public, even among the agencies that collect them. Few communi- 
ties go to the added effort and expense of collecting survey data, al- 
though this is an excellent way to achieve a complete picture of the status 
of youth and the social factors affecting their development. Over the 
past decade, however, the number of communities conducting surveys 
has increased substantially. 

In this section we review the data resources available to communities 
through the lens of the youth development framework developed in this 
report. This framework identified four outcome domains of develop- 
ment — described as personal and social assets — in Chapter 3 and eight 
social setting domains — described as features of positive developmental 
settings in Chapter 4. We also include “negative outcomes and behav- 
iors” as a separate outcome domain. 

We examine the types of indicator data available in each of the do- 
mains in our framework for commonly available administrative data, 
and for three of the more advanced survey instruments used for assessing 
youth development at the community and state levels. These are re- 
viewed in terms of their coverage across the domains, data and measure- 
ment quality, and the extent to which their measures are grounded in the 
scientific literature. Topic-specific research instruments and national 
surveys are also discussed. 2 The section finishes by considering issues of 
public access to the data generated by these sources. 



2 Several major federal publications series, not reviewed here, provide regularly updated 
trend data on children and youth across a wide variety of domains. These include: 
Trends in the Well-Being of America’s Children and Youth {<http://aspe.hhs.gov/hsp/ 
99trends>) 
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Administrative and Related Sources 



Every community collects a substantial amount of data on their chil- 
dren and youth. Administrative sources include school records, educa- 
tional assessments, vital statistics (birth and death records), police data 
on reports and arrests, child welfare and public assistance records, health 
surveillance systems, emergency room admissions data, and so on 
(Coulton and Hollister, 1998; Coulton, 1995). In addition, data from 
the decennial census provide detailed economic and demographic infor- 
mation on youth, their families, and their neighborhoods. 

These data have a number of advantages in addition to their ubiq- 
uity. First, someone has already paid for their collection. If they are not 
already available to the public, they can often be made available at a 
relatively modest cost. Second, many of these sources are capable of 
generating indicator estimates down to the neighborhood level. This is 
particularly important for community programs for youth, many of 
which serve limited geographic areas within the larger community. 
Neighborhood-level data allow programs to make strategic location de- 
cisions to areas of greatest need, assess needs and strengths in neighbor- 
hoods they already serve, and track changes in these characteristics over 
time. The last is particularly important for community programs for 
youth when their goals extend beyond program participants to include 
changes at the neighborhood level (e.g., reductions in gang activity). 

Third, administrative data provide information that cannot be gath- 
ered using existing community surveys on youth development. Stan- 
dardized education assessments, for example, are important measures 
that are not covered by such surveys. Neighborhood characteristics (e.g., 
crime levels, teen birth rates) derived from administrative reporting sys- 
tems provide indicators of social settings that are more objective in the 
sense that they are not dependent, as the surveys are, on youth percep- 
tions. 

Some potential problems with these data should be kept in mind. 
First, many of these sources can have problems with data quality and 
consistency (Coulton and Hollister, 1998; Coulton, 1998). For example, 



Youth Indicators 1996: Trends in the Well-Being of American Youth (<http://nces.ed.gov/ 
pubsearch/pubsinfo.asp?pubid=96027>) 

America’s Children: Key National Indicators of Well-Being: 2000 (<http:// 
www.childstats.gov>) 
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changes in police policy for the disposition of juvenile offenses may re- 
sult in dramatic increases or decreases in arrest rates without any change 
in the actual rate of juvenile crimes committed. Even census data, which 
are very reliable overall, have been shown to substantially underestimate 
the number of both black and white children in large urban settings (West 
and Robinson, 1999). 

Second, data sources often use different and incompatible geographic 
units when they report (e.g., school catchment area, census tract, health 
district, or other specially defined service area). This can limit the ability 
to draw on multiple data sources to produce a picture or profile for 
particular neighborhoods. 

Other problems can include a lack of separate estimates for impor- 
tant population subgroups (e.g., Hispanics), long time lags between data 
collection and release, and a lack of public accessibility. In many com- 
munities, estimates that could support planning efforts outside local gov- 
ernment never make it beyond the walls of the agencies and departments 
that collect them. 

Table 8-1 presents the types of indicator data available from admin- 
istrative data and from the three community survey instruments we re- 
viewed, sorted by the domains in our youth development framework. In 
the youth outcome domains, administrative data are quite strong in the 
areas of cognitive development, negative outcomes or behaviors, and 
physical health. They are weak sources of indicator data in the areas of 
psychological, emotional, and social development. And, with the excep- 
tion of the cognitive development domain, the indicators are heavily 
weighted toward negative outcomes. This should not be surprising given 
the reliance on crime, vital statistics, health surveillance, and social ser- 
vice receipt data, all of which focus primarily on negative events. 

Among the social setting domains that influence youth development, 
administrative data are strongest in the safety, social norms, and oppor- 
tunities for skill building domains. They are weak to nonexistent in the 
structure, emotional and intellectual support, opportunities for efficacy, 
and integration domains. 



Community-Level Surveys of Youth 

For this review we have chosen three of the best known and most 
widely used surveys of youth at the state and community levels. All three 
surveys are based entirely on youth reports, are commonly administered 
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in the classroom, are relatively inexpensive to administer and process, 
and take an hour or less to complete. These are: 

° Profiles of Student Life: Attitudes and Behaviors; 

° the Student Survey of Risk and Protective Factors, and Prevalence 
of Alcohol, Tobacco, and Other Drug Use; and 
° the Youth Risk Behavior Survey. 



Profiles of Student Life : Attitudes and Behaviors 

The Profiles of Student Life: Attitudes and Behaviors (PSL-AB) sur- 
vey, developed by the Search Institute, has been administered in over 
1,000 communities since 1989. It is designed for youth in grades 6 
through 12 and is based on a comprehensive framework grounded in the 
youth development literature (Scales and Leffert, 1999). The framework 
includes eight asset areas: four internal (commitment to learning, posi- 
tive values, social competencies, and positive identity) and four external 
(support, empowerment, boundaries and expectations, and constructive 
use of time). There are 40 assets in all, as well as multiple measures of 
thriving and risk behaviors. 

The questions used in the survey were culled primarily from national 
surveys. About half of the assets are measured as scales based on three 
or four items. A psychometric analysis of these scales revealed 
Cronbach’s alpha coefficients ranging from to .31 to .82, with about 
two-thirds of the scales exceeding the .60 level, a common cutoff point 
used in research. The validity of the assets is primarily face validity 
based on their relationship in the research literature to the promotion of 
healthy behavior, the prevention of risk behaviors, or both. Analyses 
based on PSL-AB data revealed strong relationships between the number 
of assets a youth has and the prevalence of risk and thriving behaviors. 
These analyses are based on large but nonrepresentative and dispropor- 
tionately white samples across multiple communities (see Leffert et al., 
1998, for details). 

Although the assets and their representative measures are grounded 
in existing academic research, the research base is, as its designers freely 
admit, rather thin or mixed for a number of the assets, such as empow- 
erment, positive values, cultural competence, self-esteem, and sense of 
purpose (Leffert et al., 1998). 

Clearly, some of the measures used in the PSL-AB race ahead of the 
underlying science, and a number of the constructed scales fall well be- 
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low accepted research minimums. However, the primary goal of the 
Search Institute in developing and promoting the use of this survey was 
to inform social action by providing communities with a common lan- 
guage, a unified and complete vision of positive youth development, and 
the means to identify and strengthen the developmental processes in their 
community. Science played and continues to play an important role in 
the development of this instrument, but there is a willingness to go be- 
yond the science when it serves an important practical purpose. 

The use of the assets framework to guide instrument construction 
has resulted in a very comprehensive survey that includes measures in 
every domain of our own youth development framework and multiple 
measures in most domains (see Table 8-1). It is the most well-rounded of 
the data sources included in this review. There are, however, no cogni- 
tive measures per se. Instead there are measures of academic motivation, 
school engagement, and related activities like time doing homework. 
Measures of psychological and emotional development include a host of 
measures related to moral character, as well as both positive and nega- 
tive measures of mental health and measures of adolescents’ capacities to 
take responsibility for their actions, plan ahead, and make their own 
choices. The survey is particularly strong in social development mea- 
sures, including participation in sports, clubs, music, art, and theater 
activities both in and out of school; volunteering in the community; ca- 
pacity for empathy and sensitivity; friendship skills; and respect for cul- 
tural diversity. Physical health measures include participation in sports 
activities, whether the student “takes care of their body,” sexual activity, 
and whether the youth has been a victim of violence. The list of negative 
outcomes and behaviors is broad and includes questions about drug use 
(including alcohol and cigarettes), violence, drunk driving, gambling, and 
eating disorders. 

The coverage in the social setting domains is nearly as impressive. 
Measures of structure include the presence of clear rules and monitoring 
of the youth’s activities in the family, the school, and the neighborhood. 
Supportive relationships are explored in the family, with adults outside 
the family, in the school, and in the community. Measures of the oppor- 
tunity to belong are weaker and rely only on whether the youth care 
about their school. Measures of social norms focus on the presence of 
positive role models among parents, friends, and other adults. Questions 
on safety focus on whether the youth feels safe at home, in school, and in 
the neighborhood. Support for efficacy and mattering questions focus 
on levels of encouragement and help to do well in school and on whether 
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the youth feel that they are given useful roles in the community. There 
are questions on skill building per se, and information in the final do- 
main (integration of family, school, and community) is limited to whether 
parents come to meetings or events at school. 



Student Survey of Risk and Protective Factors , and Prevalettce of 
Alcohol , Tobacco , and Other Drug Use 

The Student Survey of Risk and Protective Factors, and Prevalence 
of Alcohol, Tobacco, and Other Drug Use (SSRP), developed by the So- 
cial Development Research Group at the University of Washington, fo- 
cuses on the risk and protective factors influencing drug use, violence, 
and misbehavior in the lives of youth ages 12 to 18. The survey was 
specifically designed to inform the development of preventive interven- 
tions to reduce youth risk behaviors in schools and communities and to 
support outcome evaluations of such interventions (Pollard et ah, 1999). 
Development was funded by the Center for Substance Abuse Prevention 
of the Substance Abuse and Mental Health Services Administration, U.S. 
Department of Health and Human Services. The survey is now being 
fielded with representative statewide samples in six states: Kansas, Maine, 
Oregon, South Carolina, Utah, and Washington. 

Risk and protective factors were included in the survey only when 
they had been found to predict future drug use and criminal or delin- 
quent behaviors in at least two longitudinal studies in the research litera- 
ture. The final instrument resulted from a rigorous development process 
that included cognitive pretesting, and pilot tests, as well as validation of 
risk and protective factors based on statewide samples of 6th, 8th, and 
1 1th grade students in Oregon. Risk and protective factors are measured 
using multi-item scales. All scales exhibit high reliability with alphas of 
.65 or higher, with most in the high .7 and .8 ranges. The factors have 
good predictive validity in their relation with the problem behaviors in 
the survey (Pollard et al., 1999a; Arthur et al., undated). 

The survey’s coverage of the domains in our youth development 
framework is broad in the sense that there is at least one measure in 
every outcome and social setting domain except one, physical health. 
However, a closer look reveals that the instrument is considerably more 
focused on negative outcomes than the PSL-AB. While the negative out- 
comes and behaviors domain is richly detailed, measures in the other 
outcome domains are a bit thin and tend to be defined in relation to risk 
behaviors. In the psychological and emotional development domain, for 
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example, measures of moral character focus on attitudes toward nega- 
tive behaviors and activities, and the measures of psychological health 
are limited to depression. One of the two social development measures 
asks about peer resistance skills against drinking. 

The indicators of social settings are considerably more well rounded 
and positive, although even here measures in the social norms domain 
focus totally on risk behaviors on the part of friends and family, and 
attitudes about risk behaviors. The survey contains multiple positive 
measures for structure, supportive relationships, support for efficacy and 
mattering, and opportunities for skill building. There is overlap between 
the PSL-AB and the SSRP constructs in these domains, although each 
contains important constructs that are not present in the other. In the 
SSRP, for example, there are several constructs related to the youth’s role 
in decision making in the family and the school. 



Youth Risk Behavior Survey 

The Youth Risk Behavior Survey (YRBS), developed by U.S. Centers 
for Disease Control and Prevention (CDC), was fielded in 42 states and 
16 major metropolitan areas in 1999. 3 A national survey was also 
fielded. It is a school-based, self-report survey of students in grades 9 
through 12. Several states, including Alaska, Montana, Nevada, Or- 
egon, Utah, and Vermont, have in some years provided the additional 
funds needed to generate samples for all school districts in the state that 
wanted to participate. One of the great advantages to communities who 
field this survey, in addition to the intrinsic value of the data, is the 
availability of comparable estimates for their state as a whole, as well as 
for the nation. A significant limitation is that it does not provide infor- 
mation on out-of-school youth, a population of great interest to many 
community programs. 

The survey was first conducted in 1990 and has been administered 
every two years since 1991. It was designed by national experts in the 
field of adolescent health, with substantial input from representatives 
from all 50 state and 16 metropolitan-area education agencies. A de- 
tailed rationale, grounded in adolescent health research literature, was 
developed for all of the measures included in the survey instrument. 4 

3 2001 Youth Risk Behavior Survey: Item Rationale for the 2001 Questionnaire. 
<www.cdc.gov/nccdphp/dash/yrbs/2001rationale.htm> 

4 To download a copy of the 1999 report, go to <http://www.cdc.gov/nccdphp/dash/ 
yrbs/index.htm> 
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The survey is composed entirely of single-item measures; there are no 
multi-item scales. States may add their own questions to the survey and 
may also choose not to field questions that they find problematic. It is 
not uncommon for states to omit certain sex-related questions, for ex- 
ample. 

The CDC works with participating state and local education agen- 
cies, which administer the survey, to produce survey samples that are 
representative of their youth in-school populations. In 1999, 22 of the 
42 participating states fielded representative samples. CDC staff receive 
raw data from participating agencies, process the data, and provide esti- 
mates back to the states. In addition, summary results that include esti- 
mates for participating states and metropolitan areas are published by 
the CDC (Centers for Disease Control and Prevention, 2000c). 

In comparison with the other surveys in Table 8-1, this survey fo- 
cuses rather narrowly on health-related conditions and behaviors. There 
are, for example, no questions related to cognitive or social development 
and only four questions refer to the social setting in which youth develop 
(including one focused on television watching). However, the questions 
in the domains of physical development and safety and negative out- 
comes and behaviors are very rich, covering important issues not touched 
on in the other surveys. Questions unique to the YRBS include: height 
and weight (from which one can develop an obesity measure); forced 
intercourse; pregnancy; the co-occurrence of drug use and intercourse; 
detailed nutrition information; use of sunscreen or sunblock at SPF15 or 
higher; timing of last routine physical exam; incidence of physical fight- 
ing with one’s boyfriend or girlfriend; and incidence of vomiting or tak- 
ing laxatives to prevent weight gain. In addition, the questions about 
physical exercise and sexual activity are more detailed than in the other 
surveys. 



Topic-Specific Survey Instruments 

In addition to the more general-purpose surveys just discussed, there 
are many more narrowly focused instruments that have been developed 
specifically for youth program monitoring and evaluation purposes. 
These instruments focus on individual constructs and commonly go into 
more depth on a topic than the more general surveys. They are most 
useful to community programs for youth trying to affect a particular 
outcome, like youth conflict resolution skills or teen pregnancy. 

An effort led by the U.S. Department of Agriculture’s Cooperative 
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Extension Service professionals working with the Children, Youth, and 
Families At-Risk Initiative and Evaluation Collaboration Project has re- 
sulted in the cataloguing of well over 100 such measurement instruments, 
with separate work groups focusing on outcomes for children, youth, the 
family, and the community. This information was created for use by 
those engaged in USDA-supported State Strengthening community 
projects, a major community development program. 

As part of this project, the Youth National Outcome Work Group 
identified multiple available instruments for the following outcome ar- 
eas: 

0 Risk behaviors: risk-taking, substance abuse, sexual activity, aca- 
demic risk, delinquency, and violence. 

° Social competencies: social competence, relationships, conflict 
resolution, decision making, social responsibility, communication, 
goal setting, problem solving, social and environmental naviga- 
tion, and valuing diversity. 

The workgroup produced a searchable database, available on-line, 5 
which includes the following information for each instrument: name, 
author, basic description, scales and subscales in the instrument, psycho- 
metric information (reliability and validity), notable advantages and dis- 
advantages, cost, contact information, and references. A separate work 
group focused on the family is producing a similar set of reviews for 
measures related to parent and family well-being. Some of the measures 
they have collected are directly applicable to the families of adolescents. 
These work groups are now disbanded, but their work continues to be a 
valuable resource. 



National Survey Instruments 

National surveys that focus on aspects of youth development have a 
number of strengths that make them good potential sources of measures 
that may be appropriated for use at the local level. First, these surveys 
are all well designed by some of the nation’s top researchers. Second, 
they offer the possibility of a national benchmark against which locali- 
ties can compare their own status. Third, and perhaps most important, 



5 The web site is located at <http://ag.arizona.edu/fcr/fs/nowg/index.html>/. 
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three of the national surveys we reviewed include parent and teacher as 
well as youth interviews. While parent interviews may be too expensive 
to undertake for community-wide surveys (in-school youth surveys are 
comparatively much less expensive), they may be appropriate at the pro- 
gram level, particularly if parents are actively involved in the youth pro- 
gram. Both parent and teacher surveys offer points of view that are 
different from those offered by youth, which can provide important ad- 
ditional information for those engaged in the development of youth 
policy and programs at the community level. 

In addition, all of these surveys are longitudinal, meaning they col- 
lect information on the same youth at multiple points in time. 6 This 
means that the youth development measures in these surveys can be rig- 
orously assessed in terms of their predictive validity for future develop- 
ment, including the transition to adulthood. 

Tables 8-2 and 8-3 list the measures and constructs, organized ac- 
cording to the domains in our youth development framework, for the 
following major national youth surveys: 7 

° National Education Longitudinal Survey of Youth (NELS) 

G National Longitudinal Survey of Adolescent Health (Add Health) 

G National Longitudinal Survey of Youth, 1997 Cohort (NLSY97); 
and 

® Monitoring the Future (MTF). 

Overall, these surveys have taken a holistic approach, offering ques- 
tions in most of the 14 domains in our youth development framework. 
While youth outcome measures are based almost exclusively on youth 
reports across all surveys, measures of social setting often include re- 
sponses from parents, teachers, and schools. The NELS and Add Health 
surveys are particularly strong in this regard, the NELS gathering infor- 
mation in every social setting domain from someone other than, or in 



6 Monitoring the Future is primarily a cross-sectional survey, but a longitudinal sample 
has also been followed over time (see Purpose and Design, Monitoring the Future Survey, 
at <http://monitoringthefuture.org/purpose.html>) 

7 For additional information on NELS88, visit <http://www.nces.ed.gov/surveys/nels88> 
For additional information on Add Health, visit <http://www.cpc.unc.edu/addhealth> 
For additional information on NLSY97, visit <http://www.bls.gov/nlsy97.htm> 

For additional information on MTF, visit <http://www.monitoringthefuture.org> 
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addition to, the youth as well as measures of cognitive skills in several 
subject areas. These multiple sources offer richer data for understanding 
social settings, providing measures of settings that are not directly af- 
fected by the well-being of the youth who inhabit those settings. 



Gaining Access to Data 

In order for community youth development efforts to take advan- 
tage of social indicators, they need ready access to the data. For many 
years, it was common for administrative data collected by one agency to 
stay within that agency, even though other government agencies and lo- 
cal private organizations could greatly benefit by using it. This is still 
true in many communities, although the situation has improved substan- 
tially over the past decade due to advances in computerization, the rise of 
the Internet, an increase in comprehensive statewide and community-wide 
planning efforts, such as the Oregon Benchmarks and Vermont’s Frame- 
work for Collaboration, and the rise of private social indicator-focused 
projects such as the Annie E. Casey Foundation’s Kids Count effort 
(Brown and Corbett, forthcoming; Kingsley, 1998). 

It is increasingly common for agencies to make their indicator data 
available to all through regular publications and on-line searchable data- 
bases. There has also been an increase in the development of data ware- 
houses, through which indicator data from many sources are made ac- 
cessible to the public. A prime example of this sort of effort at the 
community level is the Cleveland Area Network for Data and Organiz- 
ing (CAN DO). Data from the decennial census, vital statistics, crime, 
child welfare, and other sources are made available in an on-line data- 
base that users can access and display in tables or maps for neighbor- 
hoods throughout Cleveland, Ohio, and the surrounding suburban mu- 
nicipalities. The data are stored in a geographic information system 
(GIS), which allows users to create complex social profiles of local neigh- 
borhoods and to map need in relation to available resources (e.g., the 
location of licensed child care programs in relation to families with young 
children). The intended consumers of these data include nonprofit, 
community-based organizations and government agencies that can use 
them to aid in planning, as well as academics, students, and the public. 
CAN DO is a member of the National Neighborhood Indicators Project, 
whose members include organizations in a dozen cities across the coun- 
try similarly engaged in the development of neighborhood information 
systems (Kingsley, 1996). 
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For social survey data for youth development, the access issues are a 
little different. Several states have provided funding and support to field 
community-level surveys that focus on youth. Oregon, Vermont, and 
several other states have done this in the past with the YRBS. Colorado 
and Vermont have done the same with the PSL-AB. The state of Minne- 
sota fields its own Minnesota Student Survey every three years, asking 
questions on a voluntary basis to all public school youth in grades 6, 9, 
and 12. In addition, many individual communities have contracted with 
the Search Institute to field the PSL-AB, using the results for comprehen- 
sive youth development planning. 

Most communities, however, do not have access to the unique and 
important information that can only be gathered using such surveys as 
the ones reviewed above. The costs of fielding such surveys are them- 
selves a barrier, although clearly many communities have made the deci- 
sion that the information gained is worth the expense. In 2000 the 
PSL-AB, for example, could be fielded for between $1.65 and $2.00 per 
youth, with additional charges of several hundred dollars each for the 
production of reports (Search Institute, 2000). 

For individual community programs for youth seeking to use social 
indicator data to monitor the activities and the success of their own pro- 
gram, the items in these surveys may be too general. For many purposes, 
such programs need to monitor elements that are specific to their pro- 
gram, looking at issues of process and implementation as well as out- 
comes. For them, a more tailored approach is needed, one that usually 
requires professional technical assistance. 



ASSESSING PROGRAM IMPLEMENTATION AND OPERATION 

When a program has just been launched, program managers, staff, 
participating youth and their parents, funders, and other stakeholders 
need information on whether it has been implemented according to de- 
sign and, if not, how services and operations differ from those envisioned 
in the program’s underlying model. When a program has moved past 
implementation into the routine operating stage, information to deter- 
mine whether it has continued to operate according to design and at the 
desired level of quality and efficiency will be similarly useful. Also useful 
will be data on total program costs and average cost per youth served. 

Until enough time has passed to allow collection of any but the most 
short-term outcome indicators, all that stakeholders have for assessing 
program progress and the possible need for change is information on 
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implementation, operation, and costs. Such information can be used to 
produce process evaluations and cost studies and to provide performance 
monitoring. Findings from these analyses can stimulate communication 
about program goals, progress, obstacles, and results among program 
managers, staff, participants, funders, and others. 

The “developmental quality” of a youth program may be defined as 
the extent to which it provides a social setting and a set of activities that 
should facilitate positive youth development. Developmental quality is 
the key characteristic that a program can directly control via its internal 
activities. It must attend to the developmental quality of youth experi- 
ences, regardless of the specific activities (e.g., mentoring, peer tutoring, 
theater productions, team sports) it sponsors. Based on regular assess- 
ments of developmental quality, a program can engage in dynamic re- 
flective practice to fine-tune its service delivery and management prac- 
tices. If so indicated, it can take corrective steps to align activities with 
the model on which the program is premised. To produce useful process 
evaluations, performance monitoring, and self-assessment, youth devel- 
opment programs therefore need valid, reliable indicators of the develop- 
mental quality of the experiences they provide. 

Indicators of developmental quality are important for a second rea- 
son. Because of their small size, informal nature, and limited resources, 
many youth development programs will never undergo a rigorous im- 
pact evaluation using control or comparison groups, nor will they obtain 
high-quality data on developmental or long-term outcomes of the youth 
they serve. For such programs, information about long-term outcomes 
over which they may exert influence but cannot directly or fully control 
(e.g., school completion, good character, civic involvement) does not 
provide a good standard for program accountability. Rather, indicators 
of the developmental quality of the program necessarily provide the key 
information for judging whether it is likely to have positive effects on 
youth development. If the program’s model is valid and data on the 
developmental quality of its activities indicate that it provides a setting 
and a set of activities that facilitate positive youth development, one may 
reasonably conclude that the program contributes to positive youth de- 
velopment. 

That is, when good impact data are not going to be available, indica- 
tors of the developmental quality of a program’s activities provide a fair 
mechanism for holding it accountable for what it can best control. This 
is an important use of such indicators besides the short-term feedback 
they can provide about program operation. Hence, we focus discussion 
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on indicators of developmental quality because of their essential and 
unique importance for youth development programs. 

Although many community programs for youth recognize the value 
of data on developmental quality, most lack the staffing, knowledge, and 
other capacity to measure it. Even if programs had wanted to do so, 
until recently they would have searched in vain for good measurement 
tools applicable to youth development programs. The development of 
such tools has been a major challenge to the field. As a more common 
understanding of how community programs for youth need to be struc- 
tured to promote positive development has emerged, there have been 
notable advances in meeting this challenge. 

The work of Public/Private Ventures (P/PV), in conjunction with 
other partners in the youth development community, exemplifies recent 
progress in developing indicators of developmental quality for any youth 
activity, regardless of its specific goals. Building on Gambone and 
Arbreton (1997), P/PV has developed a sophisticated set of forms and 
scales to assess seven dimensions of developmental quality, each with 
subcategories. They are adult-youth relations, peer support, quality of 
staff presentation, behavior management, opportunities for decision 
making and leadership, youth engagement in the activity, and the quality 
of the space or location. These seven dimensions encompass the eight 
factors that facilitate youth development identified in this report. 

Observers use the instrument first to record information on an activ- 
ity, focusing on observations of positive and negative behaviors for each 
subcategory. They then use the observations to evaluate each dimension 
of the activity’s quality. The instrument seeks both quantitative and 
qualitative observations and judgments. After using it to record three 
independent observations and assessments of the activity, observers pre- 
pare an overall assessment and recommendations for improvement. To 
foster uniform implementation of the evaluation instrument, observers 
receive a manual that provides detailed instructions on how to observe 
and assess activities and fill out the forms. The instrument does not 
produce a summary measure of an activity’s overall developmental qual- 
ity. Rather, it yields a rich picture of the degree of success a program is 
achieving along multiple dimensions that contribute to developmental 
quality. 

Independent observers have used the instrument to evaluate activi- 
ties in the San Francisco Beacons Program and will use it to evaluate 
Extended Service Schools, supported by the DeWitt Wallace Reader’s 
Digest Fund. In the future, executive directors and other supervisors 
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could use it to evaluate their organization’s activities. If supervisors de- 
cide to share the evaluation forms with their activities’ leaders and tell 
them that the criteria on the forms are what they were going to be evalu- 
ated on, the forms could help leaders see that an activity can mean much 
more to youth than just an opportunity to do whatever its specific goal 
happens to be — making pottery, playing basketball, learning computer 
skills, etc. Efforts are under way to more fully automate data collection 
and processing via hand-held computers. Although still a work in 
progress, this instrument represents cutting-edge practice. 

Even if a program scores high on factors that promote developmen- 
tal quality, it needs to know whether each participating youth experi- 
ences meaningful involvement with its positive development environ- 
ment. Thus, programs also need indicators of participation over time by 
individual youth to measure the “dosage” of developmental factors. Yet 
the best that most programs currently do is collect daily attendance in- 
formation. 

Youth, of course, may simultaneously attend more than one pro- 
gram, switch programs over time, or mix program participation with 
involvement in other activities (e.g., extracurricular school activities, 
music lessons, religious training) that may also contribute to positive 
development. High-quality dosage data therefore cannot be based en- 
tirely on individual agency records but require tracking individual youth 
across programs and other activities. 

The Community Network for Youth Development (CNYD), a local 
intermediary organization based in San Francisco, has advanced the use 
of data for reflective practice through its Youth Development Outcomes 
Project. CNYD grounds its work with agencies in a coherent, research- 
based youth development framework developed in conjunction with the 
Community Action for Youth Project (CAYP). CNYD brings together 
funders and youth-serving agencies to build consensus and agency 
capacity around issues of assessment, accountability, and best practice to 
promote healthy youth development. 

The outcomes project led to the creation of two surveys — one for 
junior high and high school youth, the other for elementary school- 
children — that provide concrete measures of young people’s program 
experiences. The questions seek to capture the extent to which partici- 
pants experience the supports and opportunities that facilitate healthy 
youth development. The dimensions of developmental quality tapped in 
this survey overlap with those in the P/PV instrument but are not identi- 
cal. The survey also gathers information on the duration and intensity of 
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a youth’s participation in the program. Findings that revealed program 
shortcomings helped engage funders and agencies in discussions of why 
programs were falling short in some areas and how resources might be 
more effectively deployed. 

A complementary self-assessment form completed by agency staff 
examines organizational practices in areas viewed as critical to support- 
ing a program’s developmental quality. These include creating safe, reli- 
able, and accessible activities and spaces; providing a range of diverse, 
interesting skill-building activities; ensuring continuity and consistency 
of care; high, clear and fair standards; and several others. 

Taken together, the participant and agency instruments provide com- 
prehensive data to help organizations create focused strategies for im- 
proving the developmental quality of their programs, given their resource 
constraints. If used skillfully in a process of quality improvement, such 
data can raise the cost-effectiveness of an agency’s management and pro- 
gramming activities. The general capacity building process and the spe- 
cific instruments show potential for replication, and the youth survey 
may be adapted for publication on the web. 

The CNYD and P/PV approaches to assessing developmental quality 
share a common theoretical framework. They overlap in the constructs 
of developmental quality they examine and how they operationalize those 
constructs. But there is an important difference between the two. P/PV 
focuses on assessing the practices of specific activities (e.g., making pot- 
tery) in terms of their developmental quality, whereas CNYD aims at 
assessing how well the overall organization fosters positive youth devel- 
opment via specific activities as well as its general organizational envi- 
ronment. Both have value. 

Evidence in Roth (2000) suggests that youth-serving organizations 
are likely to welcome assistance for building their capacity to assess the 
developmental quality of their programs and act on those assessments. 
Roth surveyed executive directors of youth-serving organizations about 
the goals and characteristics of their programs. Many of the program 
goals reported by directors match up well with the personal and social 
assets of positive youth development discussed in this report. She also 
found that many program characteristics reported by directors are closely 
related to our list of features of positive developmental settings. 
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Qualitative Data for Community Programs for Youth 

Thus far this chapter has focused on quantitative social indicators 
and measures of program implementation, operation, and impact. This 
focus reflects the fact that most resources for data collection and pro- 
gram evaluation have been channeled in quantitative directions. Like 
experimental evaluation methods, quantitative data are often viewed as 
more objective, easier to understand, and more highly valued by funders 
and policy makers than qualitative data. 

Nonetheless, as has been suggested in the last few chapters, qualita- 
tive data can also play important roles in the design, implementation, 
and evaluation of community programs for youth and aid in the under- 
standing of the process of positive youth development. Methods to gen- 
erate qualitative data on programs and the social and cultural context in 
which they operate include direct observation; open-ended interviews 
with key informants, staff, and participants; focus groups; ethnographic 
studies; the use of diaries kept by informants; and detailed case studies. 

Correctly understood, qualitative data neither are inferior to nor 
substitute for quantitative data (Lin, 2000). Rather, by trading breadth 
for depth, qualitative data can complement statistical evidence in several 
respects (Sherwood and Doolittle, 2000). Data from field research can 
play an important role in planning the specific way services are provided. 
For example, qualitative research on the determinants of successful 
mentoring relationships is fairly consistent about what practices make 
for effective mentoring (Sipe, 1996). Such findings can be translated into 
guidelines for coaching and supervising mentors on an ongoing basis. 
Identifying better mentoring styles would be very difficult with standard 
quantitative survey methods. Focus groups can be used to help design 
services that more fully respond to the realities of the intended clients’ 
lived experiences and motivations. Hence, such services are more likely 
to be used (see Furstenberg et al., 1992 as an example of this use of focus 
group data; see Branch et ah, 1998 as an example in the youth program 
area). 

Detailed interviews and observations of line staff and participants 
are essential to determine if actual program operations are, in fact, those 
intended by the program planners. Such information allows evaluators 
to decide whether the quality of program services was sufficient to pro- 
duce a fair test of whether the services made a difference. It can offer 
insights about the reasonableness of the underlying model and about 
problems likely to arise during implementation and ongoing operation. 
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These insights would also provide lessons for replication. For example, 
Plain Talk, a community program aimed at improving adolescent knowl- 
edge of sexuality and use of methods to prevent pregnancy and sexually 
transmitted diseases, took a long time to implement. Field research 
showed that community lay trainers needed more time than initially en- 
visioned to become sufficiently comfortable with sexuality issues before 
they were ready to engage other members of the community (Walker and 
Kotloff, 2000). 

The P/PV instruments discussed earlier collect both qualitative and 
quantitative information for assessing the developmental quality of youth 
activities. The quantitative data provide a general view of which aspects 
of an activity are running satisfactorily and which may need improve- 
ment or intervention by senior management. But only the qualitative 
data can provide information on the specific behaviors of staff and youth 
and the details of daily activities that would allow the program managers 
to take concrete steps to improve operations. 

Qualitative data may yield more complete, more nuanced, and con- 
text-specific understandings of the nature of correlations and causal rela- 
tionships in the process of youth development that have been uncovered 
by quantitative data (e.g., by using some of the major datasets discussed 
in this chapter). Similarly, qualitative data can help explain subtle causal 
mechanisms through which a program works (or fails to work) — the 
“how,” whereas quantitative analysis typically shows only “how much” 
the program affected an outcome of interest. Such data can play a key 
role in formal, extensive impact studies if gathered early in the project 
and used to develop hypotheses that are investigated further through 
subsequent quantitative work. If time permits, additional qualitative 
research can then elucidate the findings from the quantitative hypothesis 
testing and suggest yet newer hypotheses — and so on through an itera- 
tive process that may yield much richer understanding than reliance on 
only one kind of data. Even community programs for youth that do not 
undergo rigorous impact evaluation can supplement small-scale quanti- 
tative assessment of program quality with data from focus groups, indi- 
vidual interviews, and careful observation of program operations. The 
latter can aid in interpreting quantitative findings as well as suggest new 
questions for future quantitative assessment. 

Qualitative data can allow exploration of how program services are 
understood and experienced both by participating youth and by those 
who choose not to participate. Neighborhood youth may have some 
idea of what motivates them, what they found stimulating in a program, 
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what drew them to it, why they were prepared to give it time over a 
period of months or perhaps years, and whether they think that partici- 
pating in it affected them in particular ways. Such data can also help 
program operators, funders, and policy makers understand what parents 
care about in programs their children may attend. They can clarify vari- 
ous stakeholders’ expectations for a program and what would constitute 
success in their eyes. 

Program research based on qualitative data has important limita- 
tions as well. Samples are often small and not necessarily representative, 
even if drawn from program participants. Verifying conclusions from 
qualitative data is difficult. So is generalizability. Qualitative research is 
costly to do well. Telling stories, however interesting or compelling they 
may be, is not a substitute for rigorous analysis of qualitative data. De- 
spite these and other limitations (Lin, 2000), qualitative data can play 
important roles in the design and analysis of community programs for 
youth. 



National Intermediary Organizations 

A number of national groups have become important in assisting 
community programs to enhance their capacity to collect and use data in 
their design, planning, and evaluation efforts. A number of these are 
focused specifically on youth development programs. These groups are 
playing an increasingly important role in the education of youth pro- 
gram staff around youth development concepts, in organizing available 
data-related materials for use by such groups, and in consulting with 
individual programs to develop data collection and analysis strategies to 
support planning and reflective practice. They are providing essential 
information and services to the youth program community. 

° The Youth National Outcome Work Groups, mentioned earlier, 
provides more than detailed information on measures relevant for 
youth development. They support work groups in the areas of 
child, youth, family, and community development. In addition to 
information on measures, they provide easy to understand primers 
for each domain of well-being covered by the work group and an 
extensive bibliography for those who are interested learning more 
about a particular domain. 8 



8 For additional information, visit <http://ag.arizona.edu/fcr/fs/nowg/ythindexintro.html> 



